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‘'Let iis Bit on ibis log at the roadside/' says L '‘and 
forgot the inhumanity and ribaldry of tlie poets. It is in 
the glorious columns of ascertained fa<'1s and legalised 
measures that beauty is to be found. In this very log 
we sit upon, Mrs. Sampson,” says 1, "is statistics more 
wonderful than any p(Kun. Tlie rings show it was sixty 
years old. At the depth of two tliousaiid feet it would 
become coal in three thousand years. The deej^est coal 
mine in the w’^orld is at Killingworth, near Newcastle. 
A l)ox four feet long, three feet wide, and two feet eight 
inches dec]) will hold one ton of coal If an artery is cut, 
compress it above the wwnid. A man's leg contains thirty 
bones. The l ower of London was burned in 1841.” 

“ (io on, Mr. Pratt,” says Mrs. fSampson. “ Them ideas 
is so original and soothing. 1 think statistics are just as 
lovely as they can be." 

O. Henky, The Handbook of Hymen. 




PREFACE 


The need for a thorough exposition of the theory of statistics has been repeatedly 
emphasised in recent years. The object of this book is to develop a systematic treatment 
of that theory as it exists at the jiresent time. Originally my intention was to complete 
the work in one volume, but the war has made such a course impossible. Nevertheless, 
this first volume is largely cornj)lete in itself and can, I hope, bo j)rofitably read in advance 
of the publication of its successor. 

In 1938 Dr. M. S. Bartlett, Dr. J. O. Irwin, Professor E. S. Pearson, Dr. John Wishart 
and 1 discussed the possibility of writing a treatise on the theory of statistics in co-operation, 
and even got as far as sketching a synopsis. This ])ropOvsal, however, had to be abandoned 
after the outbreak of war. and with some misgivings I decided to proceed alone. My ]>re,sent 
treatment differs very considerably from the one then agreed upon, since a number of 
sacrifices of vievj)oint made for the jmrposo of reachi^ig unanimit y are no longer necessary. 
I must accordingly assume sole resf)onsibility for the form and content of the present book, 
but acknov l(Mlgment is duo to my colleagues for the ]ie]])ful discussions which took place 
while the synopsis of tlie original j)rc>[)OsaI was being drafted. 

Apart from the usual problems arising in writing any book with pretensions to com- 
preliensiveness—emphasis, rejection of uiiimportant mateiial, sequence of [uesentation, 
and so forth—there A\ere two main questions to decided in regard to this book : the 
amount of mathematics admitted, and the f)oint of introduction of the theory of probability. 
Statistical theory is essentially mathematical, and I have not hesitated in fact I have 
been compelled-" to adopt a rather advanced mathematical treatment in order to acliieve 
rigour where it is attainable in the present state of our knowledge. Nevertheless 1 have 
tried (in places, [)erliat)S, witli indifferent success) to kee]) the mathematics to heel. 
This is intended to h(‘ i l^ook on statistics, not on statistical mathematics. 

As to tlu5 ]>lace of the theoiy of probability, 1 have felt it preferable to deal with tlje 
descriptive ])roperties of frequenevHiistributions before intiodueing the ])robahility concept. 
This is justified botli })y tlie histori(*al development of llie sulqect and by the necessities 
of a logical ])resentation. Some readers may feel that the w hole theory of modern statistics 
is so permeated with the samf)!* )g concejffiou that an earlier introduction of ])robability 
w^ould more than offset the loss in logical sequence by the gain in didactic force. This 
view' J myself hold to be fundamentally wrong, but if tlic reader feels keenly on the subject 
he has, after all, merely to read Clia]>tcrB 7 and 8 immediately after Chapter 1 and the 
difficulty is to a great extent resolved. 

The subjects covered by the present volume may be considered under three main 
heads. Chapters 1 to G deal wdth Frequency-Distributions and their properties. Chapters 
7 to 11 deal with the Theories of Probability and Sampling and with the Sampling Dis^ 
tributions to which they lead. Broadly, tliis section comprises the theory of those distri¬ 
butions which are derived from parent populations for special purposes such as inferences 
in probability, and may be termed the Theory of Derived Distributions. Chapters 13 to 16 
deal with the Theory of Correlation, considered as a measure of relationship, the general 
theory of regression analysis being left to the second volume. Cha})ter 12, on the ;^^-di8- 
tribution, is perhaps something of an intrusion in the development, but in view of the 
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widespread applications of in testing agreement between theory and observation I felt 
that it should be introduced at an early stage. 

Thp second volume will deal with the Theory of Estimation, Regression, Analysis 
of Variance, Tests of Significance, Multivariate Analysis, Tlieories of Statistical Inference, 
and Time Series. In the first volume it has been possible to avoid a detailed examination 
of controversial topics connected with the logic of inference in probability; the subject 
will be taken up more systematically in the second volume. 

On the invaluable principle that example is better than j)recept, a special effort has 
been made to exemplify the theory at every stage and to provide exercises for the reader 
to work out for himself. Some of the latter are rather difficult, but have nevertheless been 
included to illustrate the scope of application of the theory and to refer to results for which 
no place could conveniently be found in the text. In assembling this material I have 
drawn freely on the wealth of research work in statistical periodicals, particularly Biometrika, 
and am glad to make acknowledgment to the authors from whose papers examples have 
been taken. 

Foremost among my more specific indebtedness is that to Dr. Leon Isserlis, who 
read the W’hole book at the galley proof stage and to whose careful .scrutiny I owe a great 
deal. I have also to thank Dr. J. O. Irwin, who allowed me to con.siilt his draft of a chapter 
originally intended for the co-operative treatise (this forms the basis of Chapter 10); 
Professor R. A. Fisher and Messrs. Oliver and Boyd, for ])ermis.sion to rci)roduce Apjjeudix 
Tables 4 and 5 from the former’s StaHslical Methods for Besearch Workers ; and the ])ub- 
lishers, Messrs. Charles Criffin and Co., and the printers, Messrs. Butler & Tanner Ltd., 
who have taken great ]iains with some very difficult manuscri])t. 

I shall be grateful to any reader who notifies me of any error, omission or ambiguity, 
from wffiich, I fear, no book of this kind can be entirely free at its first a])|)caranoe. 

M. G. KENDALL. 

London, 

February Isl, 1943. 
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INTRODUCTORY NOTE 


0.1 • The chapter-sections in this book are numbered serially. The serial numbers 
are prefixed by the number of the chapter in which they occur and are separated therefrom 
by a period, e.g. 14.13 refers to the thirteenth section of Chapter 14. A similar procedure 
is followed for tables, equations and exorcises, e.g, (7.15) refers to tlie fifteenth equation 
of Chapter 7, In cross-references, chapter sections are denoted by clarend m type, the others 
by ordinary type. 


0.2. References to printed work are given by author’s name and date of publication. 
In the list of references at the end of the chapter authors are arranged alphabetically. 
Where articles from publications are referred to, the number c ^ the volume is given in 
clarendon type and the number of the first page of the article in ordinary type, e.g. Ann. 
Math, Statist., 10^ 275, refers to the article beginning on page 275 of volume 10 of the Annals 
of Matimnaiical Siatisiics. Where an exercise is followed by an author’s name and a date, 
the result given in the exercise apjiears in the article listed in tlie references to the chapter 
concerned under these particulars. Where the lesuit is from an article not previously 
referred to a full n'ferencx* is given. 


0.3. The mathematical notation is that in current use, but a few symbols may be 
explained 

(1) The exclamation mark ^ written after an integer means the factorial of that integer. 
Some writers give tlie symbol a more extended use for non-integral numbers by waiting 

.r’ - r(x + 1) - f e H^dt. 

Jo 


This, of (soiirse, accords witli the factorial notation, but will not be used in this book. 


(2) The combinatorial sign 


r\{n ry 


will be used in place of the older 


} n 


(3) The summation sign will be wTitten as 27, e.g. ^ + . . . b 

) » » 

The symbol ^ (*an as a rule be shortened to ^ and in many cases to ^ or merely to 

ji f 

2’, the extent of the summation oeing clear from the context. 

(4) The ordinary notation foi tl^e T-function (given above), the J5-funetion, and the 
hypergeometric function will be used, i.e. 

J' .-(I - -rf. - 


and 


l.y 


9c(x h + I) 

1 .2.7(7 + 1) 


±ili* I 4 

i.2.3. 7(7 4 1)(7 4 52) 


(6) Where the exponent is concise, the exponential function will be written as a power 
of e, for example But where it is lengthy we shall use the notation exemplified by 

exp { - l(a;® — 2pxy 4 y®)} instead of 

xi 
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0.4, In some fields it is useful to preserve a distinction between a statistical parameter 
in a population and the estimate of that parameter from a sample. Where possible, the 
former will be denoted by a Greek letter and the latter by a Roman letter, e.g. the product-- 
moment correlation coefficient of a population is denoted by p and that of a sample by r. 
It is not, however, always possible to preserve this distinction, as for instance with the 
multiple correlation coefficient R, in which case a Greek capital would be confused with the 
Roman P. Complete notational consistence can only be achieved at the expense of 
jettisoning a great deal of accepted statistical usage, and even then would probably 
result in some cumbrous symbols. 

0.5* In order to enable the reader to follow the worked exami)les and illustrative 
material, a few^ tables of functions commonly required are given at the end of this volume. 
These tables are in no way a substitute for the comprehensive sets which have been pub¬ 
lished and which are a necessary adjunct to most pra(‘tical and a good deal of theoretical 
work* Frequent reference will be made to the following : - 

Tables for Staiisficiaus and Biowefricians, edited by Ivarl Pearson, Parts I and II, Biometrika 
Office, University College, Lonrlon, W,(M. 

SfalisticxJil Tables for 7 ise in Biological, Agricultural and Medical Research, by R. A. Fisher 
and F. Yates, Oliver and Boyd. Edinburgh. 

The following are also useful “ 

Tables of the Incomplete F-function, edited by Kail l^earson, Biometrika Office, University 
College. Jjondon, W.C.l. 

Tables of the Incomplete B-function. edited by Karl Pearson, Biometrika Office, XTruversity 
College, London, W.C'.l. 

Kelley Statistical Tables, by T. L. Kelley, Macmillan, London and New York. 
'‘Tables of Pearson’s Type ITT Function.'’ by L. R. Salvosa, Ann. Math, Statist,, 11)30, 
1, 191, 

Tables of the Higher Mathematical Functions, edited by H. T. Davis, Parts I and IL Principia 
Press, Bloomington, Indiana. 

Tables of Random Sampling Kimhers, by Ij. H. C. Ti])}>ett, Tracts for Comfiuters, No. 15, 
(Jambridge University Press. 

Tables of Random Sampling Numbers, by JVl. (i. Kendall and B. Babingtou Smith, Tracts 
for Computers, No. 21, Cambridge University Press. 

Tables of the Correlation (\>efficienf, by F, N. David, Biometrika Office, University College, 
London, W.C.L 

l^ables of tan ^ x and log (1 + .r^). b> L. .1. Comrie, Tiucts for C/omputers, No. 23, 

Tables of the Probability Integral, by W. F Shejifiard. British Association Mathematical 
Tables, Vol. 7, (Jambridge Univeisity Pres>s. 

0.6. The referen(‘es given at the end of the chapters are mainly intended to guide 
further reading and are not exhaustive. A more conifdete bibliography will be found in 
Mr. Yule’s and my Introduction to the Theory of Statistics, which contains about 700 refer¬ 
ences to work apjvearing up to about 1932, and in the valuable periodic reviews of recent 
advances in theoretical statistics appearing in the Journal of the Royal Statistical Society 
and the Journal of the American Statistical Association, A recently-begun monthly publica¬ 
tion by the American Mathematical Society, Mathematical Reviews^ also contains material 
of interest in this coimoction. 



CHAPTEE 1 

FREQUENCY-DISTRIBUTIONS 


Statistics as the Science of Populations 

1.1. Among the many subjects about which statisticians disagree is the definition 
of their science. In the Revtie de Vlnstitut International de Statistique fnr 1936 (vol. 3, 
page 388) Dr. W. F. WiUcox listed well over a hundred definitions of statistics, and the 
list was far from exhaustive. Even when we exclude those definitions which were formulated 
before the subject reached its present extent we are left with a variety of choices, and 
there is no definitive description of the scope of the science of statistics with which we 
can begin this book. 

1.2. The fundamental notion in statistical theory is that of the group or aggregate, 
a concept for which statisticians use a special word—“ population ”. This term will be 
generally employed to denote any collection of objects under consideration, whether 
animate or inanimate; for example, we shall consider populations or men, of plants, of 
mistakes in reading a scale, of barometric heights on different days, and even populations 
of ideas, such as that of the possible ways in which a hand of cards might be dealt. The 
notion common to all these things is that of aggregation. 

It is with the properties of populations that statistics is mainly concerned. In con¬ 
sidering a population of men wo are not interested, statistically speaking, in whether some 
particular individual has brown eyes or is a forger, but rather in how many of the individuals 
have brown eyes or are forgers, and whether the possession of brown eyes goes with a 
propensity to forgery in the population. We arc, so to speak, concerned with the properties 
of the population itself. Such a standpoint can occur in physics as well as in detaiographic 
sciences. For instance, in discussing the behaviour of a gas we are not so much interested 
in the behaviour of particular molecules, as in that of the aggregate of molecules which 
go to compose the gas. The statistician, like Nature, is mainly concerned with the species 
and is careless of the individual. 

1.3. We may therefore begin an approach to a definition of our subject by the 
following ; statistics is the branch of scientific method which deals with the properties 
of populations. This, however, is r ‘ ther too general. Statistics deals only with the 
numerical properties. A dictionary, for example, sets out a population of words, and 
among the properties of that population which arc a suitable subject for scientific inquiry 
is that of word-derivation. It is not of statistical concern, however, to know that some 
words are derived from Latin, some from Anglo-Saxon and some from Hindustani. The 
subject would only assume a statistical aspect if we were to inquire how many words were 
derived from the different sources. 

1.4. As a second approximation to our definition we may then try the following: 
statistics is the branch of scientific method which deals with the data obtained by counting 
or measuring the properties of populations. 

This again is a little too general. A set of logarithm tables is a population of numerals, 
but it is hardly a subject for statistical inquiry, for every numeral is determined according 
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to mathematical laws. The statistician is rather concerned with populations which occur 
in Nature and are thus subject to the multitudinous influences at work in the world at 
large. His populations rarely, if ever, conform exactly to simple mathematical rules, 
and in fact it is in the departure from such rules that he often finds topics of the greatest 
statistical interest. To allow for this factor we maj*^ then formulate our definition as 
follows :— 

Statistics is the branch of scientific method which deals with the data obtained by 
counting or measuring the properties of populations of natural phenomena. In this 
definition “ natural phenomena ” includes all the happenings of the external world, whether 
human or not. 

This is as far as we need pursue the matter. The reader who is interested enough to 
look through the definitions listed by Dr. Willcox in the article referred to above will 
find, I think, that in the light of this definition there is a perceptible thread of continuity 
running through them. 

1.5. For the avoidance of misunderstandings in the interpretation of this definition 
it may be as well to point out that “ statistics,” the name of the scientific method, is 
a collective noun and takes the singular. The same word “ statistics ” is also applied to 

? the numerical material with which the method operates, and in such a ease takes the 
plural. Later in this book wo shall meet the singular form “ statistic,” which is not, 
as might be supposed, an individual item of information which in the aggiegate would 
compose “ statistics,” but is the name given to an estimate of certain unknown measures 
of a population. 

Frequency-Distributions 

1.6. Consider a population of members each of which bears some numerical value 
of a variable, e.g, of men measured according to height or of flowers classified according 
to numbers of petals. This variable we shall call a variate. If it can assume only 
a number of isolated values it will be called discontinxious, and if it can assume any value 
of a continuous range, continuous. The population of members will then correspond to 
a population of variate-values, and it is the properties of this latter population wdiich 
we have to consider. 

If the population consists of only a few members we can without much difliculty 
consider the population of variate-values exhibited by them ; but if, as usually happens, 
the aggregate is largo {or, in a sense defined later, infinite), the set of variate-values has 
to be reduced in some way before the mind can "rasp their significance. Tliis is done 
by classification of the individuals into ranges of the variate. So far as possible the ranges 
should be equal, so that the numbers falling into different ranges are comparable. The 
interval is called the class-interval (or simply the interval) and the number of members 
bearing a variate-valuo falling into a given class-interval is the class-frequency (or simply 
the frequency). The manner in which the class-frequencies are distributed over the 
class-intervals is called the frequency-distribution (or simply the distribution). 

1.7. Tables 1.1 and 1.2 give some frequency-distributions of observed populations 
classified according to a single variate. Table 1.1 shows the 1667 Local Government 
Areas of England and Wales distributed according to the variate “ birth-rate.” Here, 
for example, there were 7 districts with a birth-rate of between 5-5 and 6-5 per thousand, 
and 271 with a birth-rate between 13-6 and 14-5 per thousand. The general nature of 
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TABLE 1.1 


Showing the Nvniber of Local Oovemnievt Areas in England tvifh Specified Birth-rates per 

Thousaiid of Population. 

(Material from the Registrar-General’s Statistical Review of England and Wales for 1933.) 





Number of 



Nuinl^er of 


Birth-rate. 

Districth with 
Birth-rat(‘ in 


Hirth-rat<\ 

Districts with 
Birth-rate in 




Spocitied Kango. 



Spocitied Kange. 

1-6 and not exceeding 2-5 

1 

13 0 

and not excet^ding 14 5 

271 

2-6 

>> 

„ 3*5 

2 

14*5 

„ 15*5 

190 

3-5 

»» 

,, 4*5 

2 

15*5 

„ ,, .6*5 

127 

4-5 

a 

„ 5-5 

3 

16 5 

„ ff 17 5 

89 

55 

>» 

6-5 

, 7 

17-5 

„ „ 18*5 

78 

6 5 


„ 7*5 

9 

18 5 

„ „ 19*5 

37 

7*5 


„ H-r> 

14 

19-5 

20*5 

21 

8*5 


„ 9f) 

41 

20-5 

,, ^1*5 

17 

9*5 


„ 10*6 

83 

21*5 

„ 22 5 

4 

10*5 

»» 

„ 11*5 

131 

22*5 

,, M 23 5 

4 

Jl-5 


„ 12-5 

i J92 

23 5 

24 7 

2 

12 5 


„ 130 

242 



— 




1 


4'otal I 

1567 j 


TABLE 1.2 

Shoioing the. Numbers of Persons, in the United Kingdom liable to Sur tax and Super-tax in 
the Year beginning 5th April 1931, classified according to the Magnitude of their 
Annual Income. 

(From tlie Statistical Abstract for the United Kingdom for the Years 1913 and 1919-32, 

C'md. 4489.) 



Annual Incomt^ 
(£009). 


Number of 
Persons. 

Nsii mated 
Fntquoncy pta* 
£590 Interval. 

2 and not exceeding 

2 5 

23,988 

23,988 

2*5 


3 

15,781 

15,781 

3 


4 

17,979 

8,989 

4 


5 

9,755 

4,877 

5 


6 

5,921 

2,960 

() 

It 

7 

3,729 

1,864 

7 


8 

2,546 

1,273 

8 


10 

3,193 

798 

10 


15 

3,016 

362 

15 


20 

1 1,328 

133 

20 


25 

679 

68 

25 


30 

378 

38 

30 


40 

372 

19 

40 

>> ? J 

50 

192 

10 

50 

99 9 ^ 

75 

182 

4 

75 

,, 100 

67 

1 

100 and ovtT 


94 

? 


Total number of portions 

89,790 
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0 5 to IS ZO 25 

Birth-rate (perthousana of population) 


Fici. 1.1, Frequoney Polygon of t.ho Bata of Table 1.1. 


the distribution is shown in this table in a way which would be quite impossible if each 
of the 1667 districts were shown separately. The greatest number of districts fall within 
the range 13-5-14-5 per thousand and the frequencies tail off on either side of this value. 
Table 1.2 shows the number of persons subject to sur-tax and super-tax in the United 
Kingdom in 1931 classified according to the variate “income.” The class-intervals here 
25 are unequal—a typical defect of official figures—and in the last column 

of the table is a reduction of the class-frequencies to comparabihty, namely, 
to frequency per £600 within the class-interval concerned. Looking at this 
column we see that the maximum frequency per £600 in this case is at the 
beginning of the frequency-distribution. 

ZO ' 

1.8. The frequency-distribution may be represented graphically. 

1 Measuring the variate-value along the a--axi8 and frequency per class- 

interval along the y-axis, we erect at the abscissa con-esponding to the 

I /s ■ centre of each class-interval an ordinate equal to the frequency per unit 

o interval in that interval. The ends of these ordinates are joined by 

g straight lines, one to the next. The diagram so obtained is called a 

I Frequency Polygon. Fig 1.1. shows the frequency polygon for the data 

^ of Table].!. 

10 * 

! , As a variant of this procedure we may erect on the abscissa 

•| range corresponding to each class-interval a rectangle whose area 

X |i8 proportional to the frequency in that interval. A diagi*am 

.constructed in this way is called a Histogram. Fig. 1.2 shows 
^ —] ifiuch a histogram for the data of Table 1.2. It is evident that 

the histogram is a 
more suitableform 

I of representation 

>^■■-‘- 4. ‘ .. 2o -S-30 class- 

AnnuAl Income (foooj intervals are un- 

Fig, L2. Histogram of the Data of Table 1,2. Oqual. 
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1.9. A few practical points in the tabulation of observed frequency-distributions 
may be noted. 

(1) It has been remarked that wherever possible the class-intervals should be equal. 
The importance of this will be more appreciated in subsequent chapters ; but it is already 
evident that comparability is difficult to carry out by inspection when there exist inequalities 
in class-intervals. On running the eye down the second column of Table 1.2, for example, 
we note that the frequencies in intervals 3-4 and 8-10 are greater than in the immediately 
preceding intervals; but this is merely due to a change in the width of the intervals 
at those points and, as is seen from the third column, the frequency per unit interval 
decreases steadily. 

(2) It is important to specify the class-interval with precision. We not infrequently 
meet with such classifications as “ 0-10, 10-20, 20-30,” etc. To which interval is a member 
with variate-value 10 assigned ? Obviously the classification is ambiguous if such values 
can in fact arise. We must either take the intervals “ greater than or equal to 0 and less 
than 10, greater than or equal to 10 and less than 20,” or make it clear what convention 
we use to allot a variate-value falling on the border between two neighbouring intervals, 
e.g. it might be decided to allot one-half of the member tq each. There are various ways 
of indicating the class-interval in practical tables, e.g. ” 10-, 20-, 30-” means ” greater 
than or equal to 10 and less than 20,” and .so forth. Sometimes, where a continuous 
variate is concerned, there is an element of imprecision in the specification of the fineness 
to which the measurements are made , for example, if we are measuring lengths in 
centimetres to the nearest centimetre, an interval shown as “ greater than 1.5 and less than 
18 ” means an interval of “ greater than 14.5 and less than 18,.5 ” When the precision 
of the measurements is known we can specify an interval by its middle point, for example, 
in this case, 16 5. 


TABLE 1 3 

Showing the Number of Deaths from Scarlet Fever at Different Ages tv England and Wales 

in 1933. 

(Data from Registrar-General’s Statistical Review of England and Wales for 1933, Tables 
Part I, Medical, supplemented by information supplied by him in correspondence.) 


Age in Years. 

Number of 
Deaths. 

Number per 
Year. 

Ago in Years 

Number of 
Deaths. 

Numboi poi 
y oar 

(K 

10 


16 

4(1- 

JO 

2 0 

1- 

09 


09 

46~ 

0 

12 

2- 

89 

[n2 

89 

50- 

7 

1 4 

3 

74 


74 

55- 

5 

10 

4^ 

74, 


74 

00- 

— 

1 

5- 

213 


42 6 

06- 

i 1 

0-2 

10^ 

70 


14 0 

70- 

' 1 

0-2 

15- 

27 


5 4 

75- 

1 

02 

20- 

20 


62 

80- 

— 

— 

25— 

17 


34 




m- 

12 


i 24 


_ 


36- 

i 11 

i 

t 

1 

22 

Toial 

729 
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(3) Remark (1) about the importance of equality of claRs-intervals should not be held 
I to preclude the specification of frequencies in finer intervals whore the frequency is changing 

very rapidly. Table 1.3^ for instance, shows the number of deaths from scarlet fever in 
England and Wales in 1933 according to the variate ‘‘ age at death/' If the frequencies 
in the interval “ 0 and less than 5 were not subdivided and were thus shown as a total 
322 for the interval, we might draw the conclusion from the uniformly decreasing number 
- of deaths as the variate increases that the greatest number of deaths occurred in the 
first year of life. This is not so, as is shown by the individual frequencies in the first 
five years. 

(4) Perhaps it is hardly necessary to add that the histogram is not a suitable method 
of representing data classified according to discontinuous variates. Jt shows the class- 
frequency uniformly dispersed over the whole interval, whereas if the variate is discon¬ 
tinuous, frequencies must necessarily be concentrated at certain points. 


Frequericy-Distributions DiscontiNVOu^ I <(nates 

1.10. It will be useful at this stage to give some examples of the frequency distri¬ 
butions which occur in practice. 

Table 1.4 shows the distribution of digits in numbers taken from a four-figure telephone 
director}\ The numbers wTre chosen by opening the dire(5tory haphazardly and taking 
the last t\^o digits of all the numbers on the page except those in heavy type. The 
distribution is irregular, but from a cursory inspection of the table we are inclined to supf)ose 
that the digits occur approximately equally frequently in the larger population from 
which these 10,000 members were chosen. We shall see later (]). 193) that the divergences 
from the average frequency per digit, 1000, are not accidental sampling effects ; but at this 
stage it is sufficient to note that the data suggest for consideration a population of erjually 
frequent members. 


TABLE J.4 

Showing Number of Different Digits chosen haphazardly froyri the Londwi Telephone 

Directory, 

(M. G. Kendall and B, Babington Smith (1938), Jour. Roy. Statist. Soc., 101, 147.) 


- - - 

. . . 

0 

1 

2 , 3 

1 

t 

4 

5 

6 

7 

8 

9 

Total. 

Frequojicy 

1026 

1107 

997 1 966 ' 

I 1 

1075 

933 

1 

J107 

972 

i 

1 

964 

j 

1 

853 

1 

1 

10,000 


Table 1.5 shows the distribution of a number of seed capsules of Shirley poppies 
according to the variate ** number of stigmatie rays." The distribution in this case is 



DISCONTINUOUS VARIATES 

more regular, there being a maximum frequency at 13 and a steady decrease on either 
side. 


TABLE 1.5 

Showing the Frequencies of Seed Capsules on certain Shirley Poppies with Different Numbers 

of SHgmnlic Rays. 


(Cited 

from (L Udny Yule (]9h2), Biornetrika, 2, 89.) 

1 

1 Nunibf^r of 

>tuiiibca of C'upsulos 

Xuuiboi of 

1 of Capsule^ 

1 Stij^iiialic Kaj/H 

with said Niinibt i 

f)f SliiinmlK Ra\ s 

Sti^Tnatio Ra>s. 

Willi said Niiinbor 

1 of Jinys. 

1 

1 

a 

14 

302 

7 

11 

If) 

234 

* 8 

3 s 

lb 

, 128 

! 9 

lOf) 

17 

1 50 

1 10 

J52 

IH 

19 

1 n 

238 

19 

3 1 

' 12 

305 

20 

1 1 


3 1 7 

To CAT 

t 1905 1 


In Table !.(>, on tlie other hand showing 8iu(*ides among women in some (^lerman 
slates in eertain years aecordiiig to the variate “ Jiumbor cT siueidos per year,” the 
distiil)iition reaeiu's its maxim uin fi(‘(|uency in the legion 1-li siiieides and then tails off' 
rathei slowly 


TABLE Id) 

Showing SuicuJe>^ of Wo?rieti in Eight ireiwan States in Four tan yearns, 
(Von Bortkiewiez, Da^s (Jesctz da llcineu Zahlen. JHOS.; 


Nuinbci of Suieidt's * 

j 

0 1 

1 

1 

1 

2 3 

1 

5 

b 

7 

8 

9 1 10 and ovor 

Total. 


9 

19 

17 20 

15 

11 

8 

2 

3 

•' 1 

1 f _ 

112 


Freqmncy-Distributions Conihiuous Variates 

1.11. Table 1.7 shows a number of adult males in the United Kingdom (including, 
at the time of the collection of the data, the whole of Ireland), distributed according to 
the variate “ height in inches.” The frequency polygon is shown in Fig. 1.3. It will be 
seen that the distribution is almost symmetrical, there being a ma.ximum ordinate at 
67- inches and a steady decrea.se in frequency on either side of the maximum. 
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TABLE 1.7 


Showing the Frequency-diatribviions of Statures for Adult Males born in the United Kingdom 

(including the whole of Ireland), 

(Final Report of the Anthropometric Committee to the British Association, 1883, p. 256.) 

A» Measurements are stated to have been taken to the nearest Jth of an inch, the class-intei’vals are here 

presumably 56 ft "57 U, 571^-58 ft, and so on. 


Height without 
Shoes (mches). 


Number of Men 
within said Limits 
of Height. 


Height without 
Shoes (inches). 


Number of Men 
within said Limits 
of Height. 


j 

— - — 

67- i 

1 2 

68- 1 

1 4 

69- 1 

1 

60- 

' 41 

61- 

1 83 

62- 

I 169 

63- 

, 394 

64- 

, 669 

65- 1 

990 

66- 

1223 

67- 

1329 

68- 1 

1230 


I 


69- 

J063 

70- 1 

646 

71- 

392 

72- 1 

202 

73- ' 

79 

74- , 

32 

75 

16 

76 

5 

77- , 

2 

ToTAn 1 

8585 


I 



Fio. 1.3. Frequency-distribution of the Data of Table 1,7. 

This more-or-less uniform “ tailing off ” of frequencies is very common in observed 
distributions, but the symmetrical property is comparatively rare. Table 1.1 is roughly 
symmetrical, but Tables 1.8 and 1.9, showing respectively a number of Australian marriages 
distributed according to bridegroom’s age, and a number of dairy farms distributed 
according to costs of production of milk, illustrate that various degrees of asymmetry 
can occur. An extreme form is shown in Table 1.3. 
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TABLE 1.8 

Showing Numbers of Marriages contracted in Australia, 1907-14, arranged according to the 

Age of Bridegroom in 3-Year Grovps. 

(From S. J. Pretorius (1930), Biometrika, 22, 210.) 


Age of Bridegroom 


Age of Bridegroom 

Number of 
Marriages. 

(Central Value of 3-year 
Range, in years). 

Marriages. 

(Central Value of 3-year 
Range, in years). 

16-5 

294 

55-5 

1,655 

195 

10,995 

58 5 

1,100 

22-5 

61,001 

61 5 

810 

25 5 

73,054 

64 5 

649 

28-6 

56,501 

67 5 

487 

31*5 

33,478 

70 5 

326 

34-6 

20,569 

73 5 

211 

37-5 

14,281 

76*5 

119 

40 5 

1 9,320 

79 5 

73 

43 5 

6,236 

82*5 

27 

40 5 

4,770 

85 5 

14 

49 5 

3,620 

88 5 

5 

52 5 

2,190 

_ — _ 




Total 

301,785 


TABLE 1.9 

Showing NnrnberM of Dairy Farmti in England and Wales according to Cost of Prodvction 

of 31 ilk in 1935-6. 

(Data from Costs of 3Iilk Producticm in England and Wales, Interim Report No. 2, 
Agricultural Economics Research Institute, Oxford.) 


Cost of Production 
(ponce jior gallon). 

No. Fariris. 

('ost of Produf’tion 
(ponce per gallon). 

N 0 . of P'arnis, 

4- 

4 

10 

65 

5- 

9 

11 - 

40 

6- 

34 

12- 

15 

7- 

77 

13- 

4 

8- 

94 

14- 

5 

9- 

88 

15- 

! 2 

t 


j 

Total 

437 

i 


In this connection Table 1.10, showing a number of men distributed according to weight, 
is of interest for comparison with the height data of Table 1.7. The latter is symmetrical 
but the former is not. 
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TABLE 1.10 

Freqaevcy-distt ibution of Weighf^s for Advif Males born in the United Kingdom. 

(Lo(\ rii., Tabki 1.7. Weights were taken to the nearest pound, consequently the true 
class-iiitervals are 89*5-99*5, 99*5-109*5, etc.) 


Woiglit III lb'. 

Froquonrj. 

Woigbt lu lbs. 1 

Freqiioiu'y. 

90 

2 

190 1 

263 

100 

34 

200 

107 

110- 

152 

210- 

85 

120 

390 

22(4 

11 

130 

8(57 

230 ' 

l(i 

140 

1623 

240 1 

11 

150 

1559 

250- 1 

8 

ICO 

1326) 

260 

1 

170 

787 

270 1 

~ 1 

JSO- 

t76 

280- ' 

1 ' 

1 


Totai. ‘ 

i 

7749 


1.12* When the asymmetry of a distribution such as that of Table 1.5 becomes 
extreme we may be unable to determine whether, near tlu' maximum ordinate, there 
is a fall on either side, or whether tlie maximum occurs right at the start of the distribution. 
This would have been the ease in Table 1 5 if we had not the finer grouping for the first 
five years of life , and it is the case in Table 1.2, in which the maximum frequency apparently 
occurs at or very close to an income of £2,000 per annum. Asymmetrical distributions are 
sometimes called “skew” : and those such as Table 1.2 are called “ J-shaped.” 


1.13. In rare cases the distribution may have maxima at both ends, as in Table 1.11, 


TABLE 1.11 

ShowingJihe Frequencies of Estimated Intensities of Cloudiness at Greemoich during the 
Years 1890-1904 {excluding 1901) for the Month of July. 

(Data from Gertrude E. Pcarse (1928), Biornetrika, 20A, 336.) 


Dogroes of 
Cloudiness. 

Frequency. 

Degrees of 
Cloudiness. 

1 

Frequency. 

10 

i 676 

4 

45 

9 

148 

3 

68 

8 

1 90 

2 

74 

7 

I 65 

1 

129 

6 

55 

0 

320 

5 

1 45 

-- — 

--- 


1 

Totai. I 

1 

1715 
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showing a number of days distributed according to degiee of cloudiness. Thi3 is known 
as a U-shaped distribution. 

1 . 14 . Distributions also occur which in general appearance resemble sections of the 
types already mentioned. A J-shaped distribution, for example, resembles the “ tail ” 
of the S 3 rmmetrical distribution of Table 1.7. The suicide data of l able 1.6 may be regarded 
as a symmetrical distribution truncated just below the maximum ordinate by the impossi¬ 
bility of the occurrence of negative values of the variate. This sort of conception is 
sometimes useful in fitting curves to observed data-—a given analytical curve may fit the 
data quite well in a certain variate range, but may also extend into regions where the 
data cannot, so to speak, follow it. 

1 . 15 . The distributions considered up to this point have one thing in common— 
they have only one maximum or, in the case of the U-shaped curve, only one minimum. 
Distributions also occur showing several maxima, Tables D12 and 1.13 being instances in 
point. The first, showing a number of deaths according to age at death, is typical of 
death distributions. Near the start of the distribution there is a maximum and a rapid 
fall in the frequency ; there is an indication of another maximum about the age 20-25 ; and 
a pronounced maximum about the age 70-75, the frequencies beyond that point tailing 
off to zero. It is natural to wonder whetlur such a distribution can be usefully considered 
as three superposed distributions, a J-shaped distribution indicative of infantile mortality, 
a more or less symmetneal single-humped distribution with a iTiaximum at 20-25, indicative 
of deaths at the adventurous age, and a skew distribution with a maximum at 70-75, the 
ordinary death curv^e of senescence. 


TABLE 1,12 

HhowiJig the Number of Male DeathrH in England and Wales for I930-S2, classified by Ages 

at Death. 

(Data from Registrar-Ccnerars Statistical Review of Plngland ind Wales, 1033, text. 


Age Death 
(yemr*^). 


Number of 


Ago at Deatli 
(y<^arh). 


Niimh(‘r of D('aths. 


0 

1 97,290 

5- 

1 11,532 

10- 

7,306 

15- 

j 13,062 

20- 

• 16,741 

25- 

1 16,126 

30- 

1 15.673 

35 

1 18,345 

40- 

1 23,778 

45- 

1 33,158 

50- 

' 43,821 


55- 

56,639 

60 

68,103 

66 

80,690 

70- 

84,041 

75- 

72,180 

80- 

45,094 

85- 

19,913 

90- 

5,146 

95- 

767 

100 aiul over 

48 

Total 

729,442 


I 
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TABLE 1,13 

Showing Number of Trypanosomes from Gloseina morsitans classified according fe> Length 

in Microns, 

(From K. Pearson (1914-15), 10 » 112. Length presumably to nearest micron.) 


Longth 

(microns). 

Frequency. 

Length I 

(microns). 

1 

Frequency. 

15 

7 

26 

110 

16 

31 

27 ' 

127 

17 

148 

28 

133 

18 

230 

29 1 

113 

19 

326 

30 

96 

20 

252 

31 

64 

21 

237 

32 

44 , 

22 

184 

33 

1 

23 

143 

34 t 

7 ‘ 

24 

115 

35 

2 

25 

130 

Totai. 

2500 j 

! 


A similar dissection of a complex distribution could be undertaken for the data of 
Table 1.13, showing a number of trypanosomes from the tsetse fly, Qlossinn morsitans^ 
classified according to length. We are led to suspect here that the distribution is composed 
of the addition of several others (and this, by the way, has led to a suggestion that the 
trypanosomes are a mixture of distinct types). 

Frequency Functioih^ and Distnhvfion Functions 

1.16. The examples given above illustrate the remarkable fact that the majority 
of the frequency-distributions encountered in practice possess a high degree of regularity. 
The form of the frequency polygons and Ixistdgrams above suggests, almost inevitably, 
that our data are approximations 1o distributions which can be specified by smooth curves 
and simple mathematical expressions. This approach to the concept of the frequency 
function, however, requires some care, particularly for continuous distributions. 

Consider in the first place a discontinuous distribution such as that of Table 1.4. Let 
us represent our variate by .r. Then we may say that x can take any of the ten values 
0, 1, ... 9 and that the frequency of x, say /(.r), is given by tlie table, that is to say, 
/(O) = 1026,/(I) = 1107,/(2) =“ 997, and so on. The frequency table, in fact, defines the 
frequency function. Furthermore, most of the frequencies in the table are approximately 
1,000, and we may then consider the observed distribution as approximating to that 
defined by 

f(x) = 1000, ;r 0, 1, . . . 9 . . . . (1.1) 

or, more generally, to the distribution 

f(x) == a: - 0, 1, . . . 9 . . . . (1.2) 

This is perhaps the simplest case of a discontinuous frequency function, f{x) being 
a constant for all permissible values of x. 
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In Table 1.5 we have a discontinuous variate which can, theoretically, take an infinite 
number of valuwi, namely, any one of the positive integers. In practice, of course, there 
must be a limit to the number of stigmatic rays which a poppy can possess, but since we 
do not know that limit we may imagine our variate as infinite in range. The frequency 
function for the table itself is again simply defined by the frequencies therein ; but if we 
wish to proceed to a conceptual generalisation of such a table we must admit a discontinuous 
function f{x) defined for all positive integral values of x. This occasions no difficulty 

provided that we are able to attach some meaning to the total frequency, i.e. that 

00 

^ /(iTy) converges. 


1 . 17 . Consider now the case of a continuous variate. In t'le ordinary data of 
experience our distributions are invariably discontinuous, because our measurements can 
only attain a certain degree of accuracy. For instance, we are accustomed to suppose 
that the height of a man may in reality be any real number of inches in a certain range, 
say 50 to 80, such as 20 ji:, In fact, we can measure hei^r^hts only to a certain accuracy, 
say to the nearest thousandth of an inch. Our measurements thus consist of whole numbers 
(of thousandths) from 50,000 to 80,000, and such a number as 62,831*85 (= 2071 approxi¬ 
mately) cannot appear. All physical measurements are subject to this limitation, but 
we accept it and nevertheless speak of our variables as continuous,” the underlying 
supposition being that the measurements are approximations to numbers which can fall 
anywhere in the arithmetic continuum. 

1 . 18 . With this understanding we can consider the distribution of grouped frequencies 
as leading to the concept of a frequency function for a continuous variate. If, in one 
of the distributions above, say that of Table 1.7, we were to subdivide the intervals, we 
should probably find that up to a point the resulting frequencies were smoother and smoother. 
The reader can verify the appearance of this elFect for himself by groujiing the data of 
Table 1.7 in intervals of 8, 4, and 2 inches. We cannot, however, take the process too 
far, because, with a finite population, continued subdivision of the interval would sooner 
or later result in irregular frequencies, there being only a few members in each interval. 
But we may suppose that for ranges Ax, not too small, the distribution ma}^ be specified 
by a function f{x) Ax, expressing that in the range ± I Ax centred at x the frequency is 
f(x) Axj wherever x may be In the perjnii^mble range of the variate, Wc ma^^ suppose further 
that as Ax tends to zero the population is perpetually rcfilenished so as to prevent the 
occurrence of small and irregular frequencies ; and in this way we arrive at the concept 
of the frequency function for a continuous variable. We write 

dF^f(x)dx .(1.3) 

expressing that the element of frequency dF between x — Idx and x f Idx is f{x) dx, for 
all X and for dx, however small. 

1 . 19 . This admittedly somewhat intuitive approach to the concept of the continuous 
frequency-distribution appears to be the best for statistical purposes, and is certainly 
the way in wliich the concept was originally reached. In formulating the axioms and 
postulates of a rigorous mathematical theory, however, the mathematician considers a 
rather more general function. There is as yet no thorough formulation of the theory 
required in this comiection, and it would be alien to the primary purpose of this book to 
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attempt one, even if the space were available. We will merely indicate in broad outline 
the general approach. 

1 . 20 . We consider a function F which is defined at every point in a continuous 
range and is continuous, except perhaps at a denumerable number of points. We require 
that F shall be zero at the lower point of the range (which may be — oo) and a constant N 
at the upper point (which may bo + oo) and that it shall not decrease at any point. Such 
a function is called a Distribution Function. It corresponds to the cumulated frequency 
of a frequency-distribution, N being the total frequency ; for example, in Table 1.4, 
F(r) -r. 0 for < 0, F{x) = 1026 for a: =- 1 and < 2, F{x) = 2133 (= 1026 + 1107) 
for u: = 2 and x < 3. and so on. Here there arc ten points of discontinuity for F{x). 
These points are called “ saltuses ” (jumps) and F(ir)inthis case is called a Step Function. 

If there is no saltus in the range, F{x) is continuous and monotonicaJly increasing. 
If it possesses a derivative we have the equation in difTerentials 

dF -= F\x) dx 

^J(x)dx . . . . . . (1.4) 

corresponding to (1.3) /(x) is called the Frequency Function. The mathematics of this 

branch of the subject is then that of the study of functions of the class F{x) and /'(r). 

1 . 21 . The functions as thus defined are more general than those arrived at from the 
statistical approach in two ways : (i) F{x) can increase monotonically in part of the 
range and then possess a saltus, i.e. the frequency may be continuous for a time and then 
suddenly discontinuous—in statistical practice a variate is either continuous or discon¬ 
tinuous, never both in different parts of the range ; (ii) where no saltus exists F(x) can 
exist without there existing a frequency function, just as a continuous function need not 
necessarily possess a derivative. In all the cases we shall consider, the exist(^nce of a 
continuous variate will be accomiianied by the existence of a frequency function. 

The function F(x) is sometimes called a Probability Function, for reasons vdiich will 
become evident in Chapter 7 when we consider the theory of probability. Essentially, 
however, it has nothing to do with probability and we shall use the term “ distribution 
function ” only. 

1 . 22 . If the discontinuous frequency function is /(r), and F(x) is taken to be the 
total frequency less than or equal to x, we have 

> 

F{x,) .(1.5) 

/ 1 

In the continuous case 



= f f{^)dx .(1.6) 

J a 

where the range is a to 6. We now introduce two conventions which simplify these expres¬ 
sions to some extent. We shall suppose, unless the contrary is specified, that in these 
mathematical expressions our frequencies are always expressed as proportions of the total 
frequencies, so that the total frequency is unity and the sum or integral over the whole 
range of the frequency function is also unity, i.e. F{b) = 1. Secondly, to avoid the 
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constant specification of the liinits a and b we may, without loss of generality, suppose that 
F{x) and f(x) are zero for any less than «, and that F{x) == 1 and f{x) = 0 for any x 
greater than 6. With this convention we may write 


and 


F(x,) == 



^■(.)=i; 


/(x) dx 


iXj 

2^ M) -i’(co) 

j -» 

f f{x) dx = F( oo) 

J — 'in 


F{~ oo) - 1 


> • 


i^( - oo) 1 


(1.7) 


( 1 . 8 ) 


Where it is necessary to take account of the total frequency N we may do so by multiplying 
by N frequencies given by the frequency function. In our convention F(x) is always 
continuous on the left. 


E.xcur.ms on SHelfje^s Iiitegrals 


1.23. The distinction between discontinuous and continuous distributions, though 
real and important for statistical j)urposes, is something of a nuisance in matJiematical 
investigations, and to avoid the necessity of stating all our theorems twice we shall use 
a type of integral due to Stieltjes. In effect, this integral subsumes under one summatory 



Suppose, in fact, that F{x) is a distribution function as we have defined it. Let ^(.r) 
be a continuous function in the range of F{x). which we will take in the first instance to 
be finite, a to b. Divide the range into n intervals at points a = Xo, x,* . . . x^^jy 

x^ == b. Take fo in the range a to Xi, in the range Xi to .rg, and so on. Let 


;S - w(S,){F(x,) - F(a)] + wiS,){F{x,) F(x^)j 

~h . . . i -nr. i)} . . . . (1.9) 


It may be shown that as the size of the intervals x ^.^. — x^ trmds to zero uniformly, 
/S tends to a limit which is independent of the location of the points f or of the boundary 
points of the intervals. We then write this limit 


\ix)dF .(1.10) 


and define it as the Stieltjes integral of xp(x) with respect to F{x). 

As for the case of ordinary integrals, we may now consider a and b as tending to infinity 
and write, for example 

f Xjr{x) dFy 

J - oo 

provided that the limit exists. 

In particular, if %p{x) — 1, w^e have the distribution function 
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1.24. If F{x) is the distribution function of a distribution possessing a continuous 
frequency function, the Stieltjes integral becomes the ordinary integral 

I y>(x)f(x)dx, 

Ju 

and thus includes ordinary integration as a particular case. If is the distribution 
function of a discontinuous distribution, that is to say, is a step function, a term such as 
^(^r+i) will vanish unless there is a saltus in the range to The sum S of 

(1.9) must then tend to the limit (since it does tend to a limit) U rp{x^) f{x^), Le, to the 
ordinary summation of a series. The Stieltjes integral thus also includes such summation 
as a particular case. 

1.25. Many of the theorems of ordinary integration are true of the Stieltjes integral. 
We shall frequently require the following : 



< r 1 v-1 dF 

. (1.11) 

1 <1 

J a 

< m\'' dF 

J a 



< M 

. (1.12) 

where M is the upper bound of y.f(x) in the range (a, b). 

rb rb 


1 fp (IF ^ j 

dF . 

. (1.13) 


a J a 


where | is a value of x in the range (a, b), ^ 

If a and b are finite 

.... ( 1 . 14 ) 

provided that Zfi(x) converges uniformly in the range. The theorem is not necessarily 
true if a and b, or one of them, are infinite. 

The ordinary iiiles of partial integration are also applicable to Stieltjes integrals. 


Variate Transformations 

1.26. Suppose we have a new variate f related to x by some functional equation 

.(1.15) 

f being continuous and differentiable in x throughout the range of x, and vice-versa. We 
have then the equation in differentials 

dx x' .(1.16) 

Consequently, for a continuous distribution 

F{x) = f dF = [ f{x) dx 

J ~ OO J —CCi 
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and consequently we may write-the distribution as 

dF 


f[m}%ds 


(1.17) 
dx 

W 


expressing that an element of frequency between f J rff and ^ + | df is f{x{i )} 

The equation determining the frequency function may then be transformed as if it were 
an equation in differentials. Such transformations are important in the theory of con¬ 
tinuous distributions. By their means many mathematically specified distributions may 
be reduced to known forma, either exactly or approximately. 

For example, a distribution which we shall have to study in the tliooiy of sampling is 


dF 






0 < < 00 . 


It is readily verified by integration that F{co) = 1. 
By the transformation ^ / we reduce this to 


dF =r -- 

r{ 


” , 

/‘•i df 


0 ^ < 00 


a well-known form in analysis, the distribution function being the incomplete jT-funciion 

(it 


"'^(3 


Again, the distribution 
dF = 


Vo 


/ > 


- oo < / < oo 


(//o being chosen so that jF'(oo) ~ l), a symmetrical peaked distribution of infinite range 
rather like that of Fig. 1.3, may by the substitution of # = be transformed 

into 

.j, _ yoV»'8ec*0dfl 

“ ■ 8ec-+'»"e' 2 ^ ^2 


= yt\/v cos*" *0 dO, 

a distribution of finite range —• ^ to but still symmetrical. Putting now sin 6 = i, 

Zi <4 

we have 

dF — i/oV^O — — 1 < ^ < 1, 

and again — x, ^ 

(IF = ~ x)'^ x~* dx 0 < a: < 1. 
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The eflFect on the range of this last substitution is to be noted. ^ ranges from — 1 to + 1» 
and as it does so x ranges from + 1 to 0 and back to 4- 1. The distribution function of 
the ^-distribution, F(x) from 0 to t, is thus that of the f-distribution from — to 
Whenever substitutions are made under which there is not a (1, 1) continuous relation 
between the variates, points such as this require some watching. 


1.27. There is one variate transformation which is worth s])ecial attention. In 
the distribution 

riF = f{x) dx 


put 

Then 


= I* /(a) 

J —-30 

dF 



- dS 0 - 


(1.18) 


so that the distribution is transformed into the very simple “ rectangular " fcu'm in whicli 
all values of the variate from 0 to 1 are equally frequent. Any continuous distribution 
can be transformc^l into the rectangular form ; and it folhnvs that there exists at least 
one transformation which will transform any continuous Ireijuency-distribution into any 
other continuous frequency-distribution, viz. the tiausformation M^hich transforms one 
into the rectangular form coupled with tlu* reverse of that which transhu’ms tlie other into 
the rectangular form. 


The GencMis of Fteqnericy-Distrlbiitiont-i 

1.28. Up to this point w^e have not inquired into the origin of tlie various observed 
frequency-distributions whicli have been adduced in illustration. CV'rtain of them may 
be considered apart from any question of origination from a larger population. Tlu' death 
distribution of Table 1.12 is an example ; if wa‘ are interested only in the distribution of 
male deaths in England and Wales in 1930-H2 tlie wdiole of tlie ])opuIation under con¬ 
sideration is before us. 

But in the great majority of eases the population whicli we are able to examine is only 
part of a larger jiopulation on which our main interest is centred. Tin* height distribution 
of Table 1.7 is only a part of the population of men in the United Kingdom living at the 
time of the inquiry, and it is mainly of importance in the light of the information wdiich 
it gives us about that jiopulation. Similarly the distribution of farms of Table 1.9 is largely 
of interest in the information it gives about costs of milk production for the whole country. 

1.29. In the two cases just mentioned, height and costs of milk production, we 
have information about a certain sample of individuals chovsen from an existing population. 
Oni}^ lack of time and op])ortunity prevents us from examining the whole population. 
It sometimes happens, however, that w^e have data wdiieh do not emanat.e from a finite 
existent population in this way. Table 1.14 is an example. It show^s the distribution of 
throws wdth dice. 
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TABLE 1.14 

Showmg the Number of Succes^ses {throws of 4, 5 or 6) with Throiv^ of 12 Dice 
(Weldon’s data, cited by F. Y. Edgeworth, Encydopwdia BriUznnica, 11th ed., 22, 39.) 



i 

- - 


Number of 
Successes. 

1 Froqiiencj. 

! 

Numbwr of 
Successes. 

1 

Frequorioy. 

0 

1 

1 0 

7 ' 

847 

1 

7 

8 

530 

2 

()0 

9 

257 ' 

3 

1 198 

10 

71 

4 

430 

11 

11 

5 

1 73i 

12 

0 

6 

948 


- 



Total 

4096 


Now it is clear that, in a sense, we have not in these flala got a complete population, 
for we can add to them by fnrtJier casting of the dice. But these farther throws do not 
exist in tlie sense that the unexarnined men of the Ihiited Kingdom or the unexarnined 
dairy farms of England and Wales exist They have a kind of hypothetical existence con¬ 
ferred on them by oui* notion of the throwing of the dice. 

Even distributions whi(‘h apjiear at tirst sight to be existent may be considered in 
this light. The trypanosome distribution of Table 1.13, for instance, was obtained from 
<*ertain tsetse flies. We ma\' consider it as a sample of all the tsetse flies in existence, 
whether harbouring tryimnoHornes or not --an existent population ; but we may also 
consider it as a sam]>le of what the distribution would be if all the tsetse flies were infected 
with trypanosomes—a hypotludieai po{)ulation. 

The population eonctuv^ed of as parental to an observed distribution is fundamental 
to statistical inference*. We shall take up this matter again in later chapters uhen we 
consider the sampling juoblem. The point is mmitioned here because it ^\ill occasionally 
arise before we reach that cha]iter. It must b(‘ emphasised tha^ the distinction between 
existent and hypothetical universes is not merely a matter of ontological speculation - if 
it were w’e could safely ignore it- but one of practi(*al importance when inferences are 
drawn about a population from a sainjik* geiKuated from it. 


M14Itivariate Distributiov .s* 

1.30. In the foregoing sections we have considered the members of a population 
according to a single variate, and the frequeiicy-distributions may thus be called univariate. 
The work may be readily generalised to include populations of members considered accord¬ 
ing to two or more variates, yielding bivariate, trivariate . . , multivariate frequency 
distributions. Table 1.15, for example, shows the distribution of a number of beans 
according to both length and breadth. The border frequencies show^ the univariate dis¬ 
tributions of the beans according to length and breadth separately, and the body of the 
fable shows how the tw^o qualities var}^ together. 
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PREQUENCY*DISTRIBUTIONS 
TABLE 1.15 


Showing Frequencies of Beans with specified Lengths and Breadths. 
(Johannsen’s data, cited by S. J. Pretorius (1930), Biometrika, 22, 110.) 
Lengths in millimetres (central values). 



17 

16*5 

16 

15*5 

15 

14-6 

14 

13*5 

13 

. 

12*5 

12 

11*5 

11 

10*6 

10 

9*5 

Totai.8. 

9*125 


2 



3 












5 

8*875 

4 

8 

17 

19 

— 

— 

— 

— 

— 

— 

— 


— 

— 

— 


48 

8*626 

2 

23 

101 

166 

93 

23 

2 

— 

— 

— 

— 


— 

— 

— 

— 

400 

8*375 

— 

18 

105 

494 

674 

227 

56 

9 

— 

— 

— 


— 

— 

— 

— 

1483 

8*125 

— 

4 

44 

375 

056 

913 

362 

73 

12 

3 

— 

— 

— 

— 

— 

— 

2742 

7*876 

— 

— 

7 

81 

385 

871 

794 

330 

89 

19 

3 

— 

— 

— 

— 

— 

2679 

7*625 

— 

— 1 

1 

4 

66 

' 236 

469 

361 

176 

55 1 

27 

4 

— 

1 — 

— 

— 

1397 

7*375 

— 

— 

— 

— 

« 1 

23 

91 

137 

124 

78 

37 

22 

11 

_ 

1 

— 

530 

7*125 

— 

~~~ 

— 

— 


1 

13 

! 18 

28 1 

36 

26 

32 

11 

1 6 

1 

— 

170 

6*875 

— 

1 

— 

— 


— 

1 — 

i 1 

9 

8 

21 

12 

13 

! 7 

1 

— 

72 

6*626 


— 

— 

— 1 


— 

— 

— 

— 

— 

2 

— 

1 

4 

3 

— 

10 

6*376 

— 

— 

— 

1 

— 

— 


.. 1 

: — 

1 

— 


— 

1 

1 

1 

4 

Totals 

6 

65 ' 

275 

1129 

' 1 

2082 

1 

2294 1 

i 1 

1787 ^ 

929 i 

) 

437 1 

199 

116 

70 

36 

18 

7 1 

! 

1 

9440 


As for the univariate case, the variates may be discontinuous or continuous and we some' 
times meet cases in which one variate is of one kind and one of the other. 


1.31. In generalisation of the frequency polygon and the histogram we may construct 
S-dimensional figures to represent the trivariate distribution. Imagine a horizontal plane 
containing a pair of perpendicular axes and ruled like a chessboard into cells, the ruled 
lines being drawn at points corresi^onding to the terminal points of class-intervals. At 
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the centre of each interval we erect a vertical line proportional in length to the frequency 
in that interval. The summits of these verticals are joined, each to the four summits of 
verticals in the neighbouring cells possessing the same values of one or the other variate. 
The resulting figure is the bivariate frequency polygon or Stereogram. 

Similarly we may erect on each cell a pillar proportional in volume to the frequency 
in that cell and thus obtain a bivariate histogram. Pig. 1.4 shows such a figure for the 
bean data of Table 1,15. 

1,32. We may write the bivariate distribution with variates Xj, m 

dF — f{x^, x^)dxxdXi ..... (1-19) 
With the usual conventions we shall then have for the bivariate distribution function 

F(Xu iTa) = f f /(ari, x^)dxidx^ .... (1,20) 

J —oc J “ ao 

this integral also being understood in the Stieltjes sense, reducing to ordinary integration 
if /(*!> X 2 ) is continuous and to ordinary summation if it is discontinuous. 


Independence 

1.33. If there are two distribution functions P,, Pj, such that 

X,) ^F,(x,)F,{x,) .(1.21) 

then Xi and x^ are said to be independent. Where frequency functions exist we have 

f f f(x,, Xi) dxi dXi = f J\{x^) dxi [ fi{Xi) dx^ 

J-ccJ-oo J—oo J — ac 

giving 

f(x^. A) ^Mxt)MXi) (1.22) 

It is readily seen that this definition of statistical independence conforms to the colloquial 
use of the word and also to its mathematical use. The distribution of for any fixed Xy 
(e.g. the distribution in a row or column of the bivariate frequency table) is the same what¬ 
ever the fixed value of Xu that is to say, the distribution of is indei)endent of Xi. 

Two variates which are not independent are said to be dependent. Evidently those 
of Table 1.15 are dependent, for the distributions in rows or in columns are far from similar. 

Generally, n variates are independent if 

F(Xi . . , a;„) = F,(Xi) . . . F,,{x„), 

1.34. Transformations of the variate for bi- and multivariate distributions follow 
the ordinary laws for the transformation of differentials. For example, if 

dF = f(xiy Xi) dxi dXi 

Xi = ^^ 1 (^ 1 , ^ 2 ) Xi = ^^ 2 (^ 1 , ti) 


we have 

where J is the Jacobian 






dxj 

dXf 

d{Xj, Xt) 



w 

a(f 1, -f.)' 


dxi 

dxt 



W,' 



is to be taken with a positive sign in (1.23). 


. (1.23) 
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Consider, for example, the distribution 


00 < Xu Xi < <X} » ( 1 . 24 ) 


2 : 0 , as usual, being chosen so that the total frequency is unity. The variates are evidently 
dependent. 

SI ^ 

Ui 0 % 


Put 


We have 


and 


= (1 - 

U 2 

^ I 

a(f.. -fj.) _' =. - e*)* 

d(^Tif X 2 ) ^ ^2 - ^ ' 0*102 

1 ^ ’0*8 

i - i- a 

Gi (TiO^ ai 


The distribution then becomes 


dF = exp {- + fS)K., d ^2 

(1 - P“)* 


2oO‘i(72 




(1 - 

The transformed variates and are thus independent. 


. (1.25) 
. (1.2(5) 


NOTES AND REFERENCES 

The collection of definitions of statistics by Willcox (1935) has aheady been referred 
to in the text. 

Examples of practical frequency-distributions will be found in most statistical journals, 
part icularly Biometrika. 

As to the mathematical basis of the theory of frequency-distributions, there appears 
to be no account in English. The reader who is interestt‘d should, however, make a point 
of reading two French works, that by Levy and those by Frechet in the Borel Traite, Both 
these are written from the standpoint of the theory of probability, but the basic ideas of 
the theory of frequency-distributions are the same whether probability is concerned or not. 

Borel, E., Traite du Calcul des Frobnbilites, Gauthier-Villars, Paris. A series of brochures 
written under the general editorship of M. Borel. See particularly the two by 
M. Frechet called Nouveaux Recherches.'' 

Levy, P., Calcitl des Probabilites, Gauthier-Villars, Paris. 

Shohat, J. (1929), Stieltjes Integrals in Mathematical Statistics,'* Ann. Math. Statist., 
1, 73. 

Willcox, W. F. (1935), Definitions of Statistics,” lievue de VInst. Ivt. de Statistiqne, 3, 388. 
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EXERCISES 

I.l. Draw frequency polygons or histograms of the following distributions 

TABLE 1.10 

Frequency-Distribution of Successes in Twelve Dice throum 4096 Times, a Throw of 6 Points 

reckoned as a Success. 

(Weldon’s data; loc. cit.. Table 1.14.) 


NuinVier of Succossos . 

1 

0 

1 

1 

1 2 

3 

4 

6 

(i j 7 and over 

XOIAL. 

j Numbor of Throws 

i 

447 

' 1145 ' 1181 

796 

380 

1 

! 115 

I 

1 

24 j 8 

4096 


TABLE 1.17 

Fiequency-Distribution of Size of Firms in the Food^ Drink and Tobacco Trades of Great 

Britain. 

(Final Report of the Fourth Census of Production, 1930, Part III. The table shows the 
number of firms employing, on an average, certain numbers of persons.) 


Size of Firm (Aver- 

111-24 

25-49 

50-99: 

100- 

200- 

300 

1 

400- 

500- 

750- 

1 

1000 ' 

1500 

Total. 

age NiimbeiH Em- 
IiJoyod). 

1 1 
1 



199 

299 

399 

499 

749 

999 

1499, 

and over 


Nuiiibor of Firms . 

2245 

1449 

77] 

439 

164 

75 

36 

54 

1 

31 

23 

29 

6316 


TABLE 1.18 

Frequency-Distribution of Plots according to Yield of Grain in Pounds from Plots of 

Acre in a Wheat Field. 

(Mercer and Hall (1911), Jour. Agr. Science, 4, 107.) 


Yield of Grain in 
por Aero, 

value of range). 

pounds 2*8 
(Central 

30 

3 2 

1 

1 

3-6 

3-8 

t 1 

40 

4-2 

4-4 

4-6 

4 8 

5 0 

5-2 

Total. 

Number of Plots 

. . . 4 

15 

20 

47 

63 

1 

i '! 

1 78 ! 

1 

88 

69 

59 

36 

10 

8 

4 

600 
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TABLE 1.19 


The Perceniagee of Deaf-mutes among Children of Parents One of whom at hast toas a Deaf- 
mute, for Marriages producing Five Children or More. 


(Compiled by G. Udny Yule from material in Marriages of the Deaf in America, ed, E. A. 
Fay, Volta Bureau, Washington, 1898. Where a family fell on the border line between 
two class-intervals one-half was assigned to each.) 


Percentage of 

Number of 

Poroentage of 

Number of 

Deaf-mutes. 

Families. 

Deaf-mutes. 

Familicjs. 

0~20 

220 

60-80 

6*5 

20-40 

20*5 

80-100 

15 

40-60 

12 

Total 

273 


TABLE 1.20 


Showing the Frequency-Distribution of Fecundity, i.e. the Ratio of the Number of Yearling 
Foals produced to the Number of Coverings, for Brood-mares {Racehorses) covered Eight Times 

at least. 

(Pearson, Lee and Moore (1899), Phil. Trans., A, 192, 303. Where a case fell on the border 
between two intervals, one-half was assigned to each.) 


Fecxmdity, 

Number of Mares 
with Fecimdity 
between the 
Given Limits. 

Fecundity. 

Number of Mares 
with Fecundity 
between the 
(hven Limits. 

1/80- 3/30 

2 

17/30-19/30 

315 

3/30- 5/30 

7-6 

19/30-21/30 

337 

6/30- 7/30 

11*5 

21/30-23/30 

293-5 

7/30- 9/30 

21*6 

23/30-25/30 

204 

9/30-11/30 

55 

26/30-27/30 

127 

11/30-13/30 

104'6 

27/30-29/30 

49 

13/30-16/30 

182 

29/30-1 

19 

16/30-17/30 

271-6 

Total 

2000-0 
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TABLE 1.21 

Shoxoing Numbers of Sentences of given Lengths in Passages from Macaxtlag's Essays cm 

Bacon and on Chatham. 

(From G. Udny Yule (1939), Biometrika, 30, 363.) 


Length of Sentence 

Number of 

Length of Sentence 

Number of 

in Words. 

Sentences. 

m Words. 

Sontonoos. 

1-5 

46 

66- 

2 

6~ 

204 

71- 

4 

11- 

252 

76- 

8 

16- 

200 

81- 

2 

21- 

186 

80- 

2 

26- 

108 

91- 


31 

61 

96- 

o ' 

36- 

68 

101- 

1 1 

41~ 

38 

106- 

1 

46— 

24 

111- 1 

1 1 

Oi¬ 

20 

116- 

-- 1 

se i 

1 12 

121 

1 

61- 1 

S 

Total 

1251 


TABLE 1.22 

Showing the Numbers of Old Egyptian Skulls with Specified Leng^ of the Left Occipital 

Bone in millimetres. 

(From T. L. Woo (1930), Biometrika, 22, 324.) 


Length 

(central values). 

Frequency, 

T..ength 

(central values). 

Frequency. 

84-5 

12 

102-5 

74 

86*5 

12 

104-6 

68 

88-5 

32 

106-6 

36 

90-5 

48 

108-6 

18 

92-5 

79 

1106 

7 

94-6 

116 

112-6 

4 

96*6 

104 

114 5 

4 

98-6 

126 

116-6 

— 

100-5 

123 

118-6 

1 

1 

I 

Total 

864 
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TABLE L23 

Showing the Number of Women Aborting at Specified Term hi Weeks. 
(From T. V. Pearce (1930), Biometrika, 22, 250.) 


Term 

(wooks). 

Frequency. 

Term 

(weeks). 

Froqu€>ncy. 

4 

3 


17 

13 

5 

7 


18 

14 

6 

10 


19 

8 

7 

13 


20 

4 

8 

14 


21 

2 

9 

29 


22 

10 

10 

22 


23 

4 

11 

21 


24 

4 

12 

18 


25 

3 

13 

28 


26 

4 

14 

16 


27 1 

6 

15 

19 


28 , 

1 

i 16 

10 


— 

[ 




Total 

' 283 

1 


1.2. Sketch the following curves and compare their Hha 2 >es with those of the 
distributions in the previous exercise :— 

_a* 

y = — 00 a; C 00 

y = 1 C cr 00 


d 

= y<>x ^ 



1, 

0 


X 

00 

y 

yo 

(1 f- X'")” 

n 

> 

0, 

- 

00 

^ X ' 00 

y 

= y«(i - xyx" 

a 

, 6 


1, 

0 


X < 1 

y 

II 

t 

y 

*::> 

1, 

0 


T 

< 00 

y 

= y„(i - x=*r 

a 

< 

0, 


1 


vT < 1. 


1.3. Show that the following distributions can all be transformed into the type 
dF = ^o(l - (hr 0 < .r ^' 1 

and find the transformations : 

11-4 

dF = ro(l ' r^) dr - 1 r ,1 

</Jf’ = . dt 00 / 00 

(‘ - 

in - 

dF --- -^z ~ CO <i z CO 

+ vA 2 

(All these distributions are important in statistical theory. The distribution to which 
they are reduced is called the Type I or B-distribution.) 



(2) Yield of Milk per \\ eek (Gallons) (Central Value of Interval ) 
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1 . 4 . Sketch the stereograms or birariate histograms of the following distributions 

TABLE 124 


dumber of Familiet> deficient in Room Space in 95 ciouxled London Wards 
(Census of 1931, Housing Report, }> xxxu ) 


Standard Room RequirtuTunit (Rooms) 


i amilif s deficient by ! 

1 2 * 

3 1 


5 

0 ^ 

i 

^ 1 

8 

^ Totals, j 

1 loom 

I 12,999 

18,19S j 

7,724 ' 

2,170 

1 I 

19 


1 41,274 ' 

j 2 rooms 

1 

3,054 

4,479 1 

1,448 1 

221 1 

15 

j 

1 

9,218 i 

1 

] 3 looms 

1 

1 


310 

508 

100 

1 

4 

1 

1 1 

929 1 

1 4 room'. 

I 



i 10 

21 

4 


CO 

1 Totals 

1 

1 12,999 

21 252 1 

1 

12,513 

1 4,130 

512 

42 

1 ^ 

51,450 


TABLE 1 J-) 

Satubfi ol ('ow'> Distributed accoidinq to (1) Aqe in Yeats and (2) Yield of Milk per Week 

ill 4912 Ayrshire Cows 

(Data from F Tochei (1028), Biomdnka 20B, 106 ) 


(1) A^e in \oair> 



3 

4 

5 

0 

7 

8 

9 

10 

11 

12 

11 

1 t 

15 

10 

17 

18 

Totals 

8 


_ 

_ 

_ 

__ 


_ 


1 

— 



- 

„ 

- 


1 

9 

— 

2 

2 

— 

1 1 


— 

— 


—- 

— 



— 

— 


5 

10 

3 

5 

1 

1 

3 

— 

— 



— 

__ 


“ 

_ 

“ 


13 

11 

2 

10 
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(2) Percentage Ratio of Reeerv^ to Deposits. 


FREQUENCY-DISTRIBUTIONS 


TABLE 1.26 

Distribution of Weekly Returns according to (1) Call Discount Bales and (2) PercmUige of 
Reserves on Deposits in New York Associated Banks. 

(From Statistical Studies in the New York Money Market^ by J. P. Norton. Publications 
of the Department of the Social Sciences, Yale University ; The Macmillan Co., 1902.) Note 
that, after the column headed 8 per cent., blank columns have been omitted to save space. 

(1) Call Discount Rates. 



1 

1-6 

2 

2-5 

3 

3-5 

4 

4-6 

6 

5-6 

6 

6-5 

7 

7-5 

8 

9 j 10 

12 

16 

20 

26 

T 0 TAI..S 

21 

22 

23 

— 

— 

— 

— 

— 


1 


1 

1 

— 

— 


— 

— 

— 

i!- 

_ 

— 

— 

— 

2 

1 

1 

24 

25 


— 

— 

— 

— 

1 

2 

1 

6 

4 

4 

2 

11 

1 

2 

— 

3 

6 

— i 2 

1 1 2 

1 

1 

— 

1 

9 

42 

26 


— 

— 

— 

2 

6 

13 

12 

16 

6 

11 

4 

7 

— 

— 

2 2 

— 

1 

1 

2 

85 

27 

— 

1 

10 

9 

14 

12 

15 

17 

19 

9 

9 

3 

4 

— 

1 

1 — 

— 

1 

— 

— 

124 

28 


5 

30 

23 

20 

11 

7 

3 

7 

1 

2 

2 

3 

— 


1 

— 

— 

— 

— 

115 

29 

3 

9 

48 

17 

16 

3 

6 

3 

1 

— 

— 

— 

2 

— 


_ 1 _ 

— 

— 

— 

1 

109 

30 

1 

12 

12 

10 

8 

4 

4 

— 

2 

— 

- 

— 

— 

— 

— 

— 1 — 

— 

— 

— 

— 

53 

31 

8 

10 

6 

2 

4 

2 

2 

1 

1 

— 


— 


— 

— 

— 1 — 

— 

— 

— 


36 

32 

15 

14 

10 

8 

5 

— 

— 

1 

_ 

— 

— 

— 

_ 

_ 

— 

— ' — 

— 

— 


— 

53 

33 

15 

8 

4 

1 

— 

1 

2 

1 

— 

— 

_ 

_ 

— 

— 

— 


i 

— 

— 

— 

32 

34 

36 

36 

2 

8 

7 

11 1 

1 

1 

— 

— 

1 — 

1 — 

— 

1 __ 

1 1 

'_ 1 

_ j 


1 — 

— 

__ i 

! n 

— 



14 

14 

10 

O 

2 

A 1 
1 i 

_ 

_ 

_1 

_ 1 

_ ‘ 

' _ 

1 _ 

; _ 1 


_ 


— 

1ZI i ZI 

_ 

_ 

_ 

_j 

_ 

37 

! 8 

— 

1 1 

— 

— 

— 

— 

— 

1 _ 


! - 

j — 1 

— 

— 

— 

1 — ' — 

— 

— 

— 

— 


38 

; ^ 

1 

1 

— 

— 

— ' 

— J 

— 

— 

1 _ 

, - 

1 — ' 

— 

— 

— 

_1 _ i 

— 

— 

- i 

— 

11 

39 

40 

41 

42 

43 

44 

45 

19 
, 7 

7 

8 

1 

1 

2 

2 

8 

j 

_ 

— 1 

— 


_ 

I 

i ^ , 

_ 1 

j _ 

i ~ 

1 _ 

! - 

1 1 1 1 ! 1 ! 

— 

_ 

1 j 

_I 

— 

_ 

1 

j 

1 21 

16 

10 

10 

1 

1 

! ^ 

Totals 

121 

93 

125 


69 

40 

1 02 

45 j 

52 

20 

. 35 j 

10 

— 

— 

10 

4 1 7 

1 1 

1 

3 

1 

4 

. 780 


1.5. Show that the conditions that the function 


Xi) — z.exp {Aaq -t- 2HxiXt +Bxl], — oo x^, .i\ < oo 

may represent a frequency function are 


,(a) A ^ 0 

(6) B < 0 

(c) AB - H* > 0. 


Show further that if these conditions are satisfied and the integral of f{Xi, x^) between 
— 00 and oo for both variates is unity, .then 


1 


\-A 

! H 


zo = 


7t 


H 

-B 









CHAPTER 2 

MEASURES OF LOCATION AND DISPERSION 


2 * 1 . It has been seen in Chapter 1 that the frequency-distributions occurring in 
statistical practice vary considerably in general nature. Some are finite in range and 
some are not. Some are symmetrical and some markedly skew. Some present only 
a single maximum and others present several. Amid this variety we may, however, 
discern four general types ; (a) the S3rmmetrical distribution with a single maximum, 
such as that of Table 1,7 ; (b) the asymmetrical distribution, oi skew distribution, with 
a single maximum, such as those of Tables 1.8 and 1,9 ; (c) the extremely skew, or J shaped, 
distribution, such as that of Table 1.2; and (d) the U-shaped distribution, ^nch as that 
of Table 1.11. To make this classification comprehensive we should have to add a fifth 
class comprising the miscellaneous distributions not falling into the other four. 

The distributions with a single maximum will hereafter be called “ unimodal.” The 
synonymous terms cocked-hat,” ‘‘ single-humped ” and one or two others also occur in 
statistical literature. 

2 . 2 . Tt frequently happens in statistical work that v»e have to compare two distri¬ 
butions. If one is unimodal and the other J-shaped or muHimodal a concise comparison 
is clearty difficult to make, and in such a case it would probably be necessary to specify 
both distributions completely. But if both are of the same type (and it is in such cases 
that comjiarisons most frequently arise) we may bo able to make a satisfactory comparison 
merely by examining their principal characteristics ; e.g. if both are unimodal it might 
be sufficient to compare (a) the whereabouts of some central value, such as the maximum 
—this, as it were, locates the distributions ; (6) the degree of scatter about this value 
—the dispersion ; and (c) the extent to which the distributions deviate from the sym¬ 
metrical—the skewness. 

The same point emerges when our distributions are specified by some mathematical 
function. If, for example, we have two distributions of the type 

(x- my 

dF = ^0 c 2v dxy 

symmetrical about x ^ m, a complete comparison can be made by comparing the value 
of the constants m and v in the distributions. Such constants are called parameters of 
the distribution. This chapter is devoted to a discussion of parameters of location and 
dispersion. 

Measures of Location: fhe Arithmetic Mean 

2 . 3 . There are three groups of measures of location in common use : the means (arith¬ 
metic, geometric and harmonic), the median and the mode. We consider them in turn. 

The arithmetic mean is perhaps the most generally used statistical measure, and in 
fact is far older than the science of statistics itself. If the proportional frequency of the 
valuer X of a distribution is/{x), the arithmetic mean pi about the point x = a is defined by 
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This integral is to be understood in the Stieltjes sense and hence includes summation in 
the discontinuous case ; e.g. the arithmetic mean of a set of discrete values x is their sum 
divided by the number of values. In formula (2.1) the frequency, in accordance with 
our usual convention, is expressed as a proportion of the total frequency. If the actual 
frequencies are gix), totalling N, we have 


Ml 


ip 


{x - a)g(x) dx 

XT J 

in the continuous case, and 

Ml 

J «. -oo 

in the discontinuous case. The value of the arithmetic mean thus depends on the value 
of a, the point from which it is measured. For a raathemaiically specified distribution 
the integral (2.1) need not necessarily converge, in which case no arithmetic mean exists. 


2 . 4 . The calculation of the arithmetic mean of a numerically specified distribution 
(i.e. one whose frequency-distribution is given in the form of a numerical table like those 
of Chapter 1) is a simple process. If Ihere are relatively few values in the population 
we merely sum them and divide by their total number N. If they are given in the form 
of a frequency table a more formal jirocedure is desirable, but the princi])k' is exactly th(‘ 
same. The following example will make the process clear 


Example 2.7 

To calculate the arithmetic mean of the population of males distributed accordingr to 
height of Table 1.7. 

Let us note first of all that if b is some other arbitrary variate-value, 


jLt\ (about rr) J 


(.r — a) dF 

^ r. (•’■ -«») ^ j 

— //’j (about b) h — 


{b - a) (IF 


- 00 

a 


( 2 . 2 ) 


In other words, we can find the mean about any point very simply when we know 
the mean about any other. In calculating the arithmetic mean we can then take an 
arbitrary point as origin and transfer to any other desired point afterwards. It is generally 
convenient to choose this arbitrary point sornewhei’o near the maximum frequency. 

One further point arises in grouped data such as this. VVe do not know exactly the 
variate-values of the individuals within a (‘ertain class range. We therefore assume them 
concentrated at the centre of the interval. Corrections for any distortion thus introduced 
will be considered in Chapter 3. In fact, no correction is required for the aritlimetic 
mean in the case when the frequency “ tails off ” at both ends of the distribution. 

In the particular case before us we take an arbitrary origin at the centre of the interval 
67- inches, i.e. at the point 67/^ inches, and measure = r — a) from that point. Column 2 
in Table 2.1 shows the frequency, column 3 the value of f and column 4 the value of f/. 
We find, having due regard to sign. 


Hence the mean about 


m) 

0 is 67-1^^^ -j- 


8763 - 
179 


8585 


8584 = 179. 

= 67*46 inches. 
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TABLE 2.1 

Cdlc'ulation of the Arithmetic Mean for the Distribution of Table 1,7. 


(1) 

(2) 

(3) 

(4) 

1 

1 


Deviation 


Height, 1 

Frequency 

from 4rhitrary 

Product j 

inches. | 

f- 

Value 

if- ' 




1 

57- 1 

2 


10 

20 

58 1 

4 


9 

35 

59 I 

14 

~ 

8 

M2 1 

«>0 1 

41 

__ 

7 

287 

61- ' 

83 

-- 

6 

49S 

62 1 

169 

— 

5 

H45 

63 ' 

394 

— 

4 

157() 

64- 

669 

- 

3 

2067 

65— j 

996 

- 

2 

19S0 

66 ' 

1 1 

1223 


1 

1223 

' 67 

1329 


6 

1 

- 8584 1 

68 

1236 

1 

I 

J 230 

1 69 

1063 

t- 

2 

2126 ' 

1 70 

641» 

-1 

3 

1938 

1 7i- 1 

392 

r 

4 

1 568 

^ 72- 

262 

1 ^ 

5 

1616 

1 73 

79 

1 + 

(> 

471 

74- 

32 

f 

7 

224 

, 75 

16 • 

1 h 

8 

128 

1 76 , 

5 

1 i 

9 

15 1 

77— 

1 

(> 

1 ^ 

16 

26 

1 

Totals 

i 

8585 

j 

- 

i 

-f 8763 


„ 


_ 



ExomjAe 2,2 

Eor a distribution specitied by a mathoniatical function, the dctcTinination of the 
mean is a matter of evaluating the integral (2.1), when it exists. For instance, to find 
the mean of the divstribution 


we have 


dF = ,(1 - x)"" ’ ’ (Ir 0 -.»•<] 

B(V-, <l) 


1 



- xY-'^x"dx 


B{p, g + 1) ^ r(p)r(q + i) r{p + q) 
B{p, q) /’(P ■+ <7 + 1)’ B(p)r{q) 


A 

P + Q 
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2.5. Apart from its relative simplicity and ease of calculation, qualities which ensure 
it a firm place in the elementary theory of statistics, the arithmetic mean has a number 
of properties which make it equally important in advanced theory. For instance :— 

(а) If in (2.1) we take a equal to itself the mean vanishes and consequently the 
sum over the population of deviations from the arithmetic mean is zero. 

(б) The mean of a sum is the sum of the means ; i.e. if/i, /a • • • /n i'be frequency 
functions of n distributions with means //i, r'l . . . and if the sum of the frequency 


functions is g with mean O', then 



= f (* - 

J —00 

~ a) g(x) dx 



=f 

- a){fi(x) +/,(*) + . 



- r {X- 

J ~ oo 

f*fXi 

- + 1 (a: 

J — 00 

~ «)/ 2 (-e) dx + . . 

. H- f (a; - a)f„{x) dx 
J — 00 


= ^1 + n -f . . . 4- pi. 


(c) We shall see later that mean values are important in the theory of sampling, 
mainly in virtue of their mathematical tractability, but also because in a certain sense 
the mean is the best measure of location of some distributions. 


The Oeotnetric Mean and the Harmonic Mean 

2.6. Two other types of mean are in use in elementary statistics, though they are 
not of importance in advanced theory. 

The geometric mean of N variate-values is the iVth root of their product and is not used 
if any of the variate-values are negative. For proportional frequencies f{x) we have 

(? = fl \ 

.(2.3) 

or log<?= £ fflogxA 

/ = oo ^ 

and for actual frequencies g(x)y totalhng 




(2.4) 


logo =^i7^,loga:;j 

The harmonic mean of N variate-values is the reciprocal of the arithmetic mean of 
their reciprocals. In the usual notation 


or, for actual frequencies, 


1 ^ r dF ^ r 
H J.« i J. 

1 ^ 

H X ' 


fj^)dx 

^ X 


(2.5) 

( 2 . 6 ) 


Example 2,3 

To find the geometric and harmonic means of the distribution 

0 < it’ < 1 


1 


dF - ^ x^-^ dx 

B(p, qy 


we have 


log G — ^)j,P “ 



THE GEOMETRIC MEAN AND HARMONIC MEAN 
Now, since by definition 
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f (1 — x)^ ^ ^ dx == B{p, q) 

Jo 


we have, differentiating both sides with respect to q^ an operation which is legiti* 
mate in virtue of the uniform convergence of the integral and the existence of the resulting 
expressions, 

J^(l — J')"'' ' log xdx = q)- 

^-log 

dq ^ r{p 4- q) 


Thus 


log 6? 


dq 


{log r{q) ~ log r{p + q) }• 


' r 

p- q)j 0 


(I .!■ i"-' ^ <ix 


The harmonic mean is given by 

^ _ 

H = B{p, 

^ B(p, q - _ r(q - 1) r(p f q) 

B(p,q) ■ /’(p 4 9 _ !)• r(q) 

__p + q - 1 
q - 1 

q I 


SO that 


H - 


P 


1 


VVe mav note that the arithmetic mean, - . is greater than the harmonic moan, for 

p 4 gr 


q 

p -1- q 


V 


1 


p 


and therefore 
if 

wliich is clearly so. 


q 9 + q 
.11 

p p 

p I- «/ - 1 V > q 


= 1 - ' 

1 p + q i- I 


2.7. In general it may be .shown that for distributions In which the variate-values 
ar<' not negative 

II G p, .(2 7) 

Oon.sider in fact the quantity 

1 


m 




4)' 


whore the .r’s are jiositive numbers. We shall show' that this is an increasing function 
of t, i.e. > E{1^) if fi «». As a trivial case those inequalities may ho replaced by 
equalities, namely if all the x's arc equal. We have 


^ I ^ f 

A'-' 


I d 

t (ft 


log 2V. 


A.S. 


i) 
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Hence, for the function 

F = log E 

Cut 

we have 


dF 
dt 

^ - {E{xnogx)Y] . . . (2.8) 

Now in virtue of Schwarz’s inequality ir(a 2 ) 2 ’( 62 ) ^ |Z’(a6)}2 the expression in brackets is 

(IF 

not negative. Hence has the sign of t and F thus has a minimum at ^ = 0. But 

when < — 0, JF = 0 and thus F must be non-negative. Therefore log E is non-negative, 
dE 

and since E is positive is non-negative and thus E is a non-decreasing function. 


-(Jjogrj? 


Now in E{t), when / i we have the arithmetic mean ; wJien / = - 1 we have the 
harmonic mean ; and when t —> 0 we have the geometric mean, for 


lim log E 
>-0 


lim 


N‘ 


2:{F) 


lim 




= ii:iog.r. 

Hence the inequality (2.7) follows. 

For simplicity we have stated these results for the discontinuous variate. The analysis, 
however, is easily seen to remain true for Stieltjes integrals and hence is gonerallj^ valid. 

Hereafter when the “ mean ” is mentioned without qualification, the arithmetic mean 
is to be understood. 


^^'The Median 

2.8. The median value is that value of the variate which divides the total frequency 
into two equal halves, i.e. is the value //^ such that 

I* f{x) dx = f f{x) dx I .(2.9) 

J —ao J ft0 

There is some small indeterminacy in this definition when the distribution is discontinuous 
which may be removed by convention. If there are (2N + 1) members of the population, 
we take the median to be the value of the (N-f l)th member. If there are 2N we take it 
to be halfway between the values of the Nth and the (N + l)th. When the distribution 
is numerically specified in class-intervals there is the usual indeterminacy due to grouping, 
which may be dealt with in the manner of the following example. 
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Emmph 2.4 

To find the median value of the distribution of heights considered in Example 2.L 
Half the total frequency of 8585 observations is 4292*5. 

There are, up to and including the interval, 66 inches 3589 

leaving 703*5 

The frequency in the next interval is 1329 

Hence we take the median to be 

703 5 

-f = 67*47 inches. 

The mean (Example 2.1) is 67*46 inches, practically the same. 

A graphical method of determining the median is given later in this chapter (2.13). 

The Mode 

2 . 9 . The mode or modal value is that value of the variate exhibited by the greatest 
number of members of the distribution. If the frequency function is continuous and 
differentiable it is the solution of 

^ ^ 

If f'(.r) vanishes and /"(.i) is greater than zero we have a minimum, and such a point is 
sometimes called an Antimodc. 

Ill numerically specified distributions and discontinuous distributions generally the 
mode is sometimes difticult to determine exactly, (t is essentially a concept related to 
the continuous frequency function. For example, if tlie distribution merely consists of 
an isolated number of values, each of which occurs only once, there is no mode in the 
sense defined above. Where, however, the number is large enough to permit grouping, 
there will usually be an interval containing a maximum frequency, and we may regard 
the mode as lying in that interval. More generally there may be several maxima, in 
which case the distribution is multimodal. In the height distribution of Table 1.7, for 
instance, the mode may be considered as lying somewhere in the interval 67- inches. 
To estimate its position more accurately it is necessary to fit a continuous curve to the 
distribution and determine the mode of the curve. The process of fitting will be considered 
in Chapter 6. 

2 . 10 . In a symmetrical distribution the mean, the median and the mode (or in 
cases such as the U-shaped distribution, the antimodc) coincide. For skew distributions 
they differ. There is an interesting empirical rclationshij) between the three quantities 
which appears to hold for unimodal curves of moderate asymmetry, namely 

Mean — Mode — 3 (Mean — Median). . . . (2.11) 

A mathematical explanation of this relationship has been given by Doodson (1917). 

It is a useful mnemonic to observe that the mean, median and mode occur in the same 
order (or the reverse order) as in the dictionary ; and that the median is nearer to the mean 
than to the mode, just as the correspondiiig words are nearer together in the dictionary. 

In elementary theory the median and the mode have considerable claims to use as 
measures of location. They are readily interpretable in terms of ordinary ideas—the 
median is the middle value and the mode is the most popular value—and the median 
is usually more easily determined than the mean in numerically specified distributions. 
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What gives the arithmetic mean the greater importance in advanced theory is its superior 
mathematical tractability and certain sampling properties ; but the median has com¬ 
pensating advantages—^it is, for instance, less dependent on the scale and the form of the 
frequency-distribution than the mean—and it seems to deserve more consideration in the 
advanced theory than it has received.. 

Quantiles 

2,11. The concept of median value can be easily extended to locate the curve more 
accurately by the use of several parameters. We may, for example, find the three variate- 
values which divide the total frequency into four equal parts. The middle one of these 
will be the median itself ; the other two are called the lower and upper rjfwriiles respectively. 
Similarly, we may find the nine variate-values which divide the total frequency into ten 
equal parts--the (hciles. GeiKTall}^ we may find the (// — 1) variate-values which divide 
the total frequency into v ec^ual })arts—the quantiles. Evidently the knowledge of the 
quantiles for some fairly high such as 10, gives a very good idea of the general form 
of the frequency-distribution. Even the quartiles and the median arc valuable general 
guides. 


2.12. The determination of the quantiles of a numerically specified distribution 
proceeds as for the median, indeterminacies being resolved by the usual conventions. 
That of the quantiles of a mathematically specihod distribution, say the yth quantile, 
is a mattei* of solving th(‘ equation 

. 

which can be done without difficulty by intei’polation when the integral of (fF has beem 
tabulated. 


EocamjiU 2,5 

To find the quartiles of the height distribution considered in 
One-quarter of the total fretpiency is 8585/4 =- 
Up to the interval 65- there are 

leaving 

In the next interval there are 


Example 2 1. 
2146-25 

1376 members 
770-25 members 
090 members 


Thus the lower quartile is 64};^ 


770 25 
990 


65-71 inches 


The uppei quartile will be found to be 69-21 inches 

We have already femnd (Example 2.4) that the median is 67-47 inches 
Denoting the quar tilcKS by Qi and we see that 


4^1 ™ ” I'^^O inches 

4^3 ^ ~ inches 


so that the median is almosft half-way between the quartiles, an indication of the symmetry 
of the distribution. 


The Distribution Curve ot Ogive of Oalton 

2.13. The quantiles may also be determined graphically. Suppose we plot x, the 
variate, along a horizontal axis and Ej{x), the cumulated frequency up to and including 



THE DISTRIBUTION CURVE 



Fig. 2.1. Distribution Curve of the Data of Table 1.2. 
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Xf along the perpendicular y-axis. 
a smooth curve may be drawn. 


We then get a aeries of points througli which, in general, 
This curve, as is evident from its definition, is 
!/ = 

i.e. the graph of the distribution function. It is sometimes called the graduation curve, 
or Galton’a ogive (though 
it is only shaped like an 
ogive in certain cases 
such as that of a uni- 
modal ay mm etrical 
curve). We shall use 
the expression distri¬ 
bution curve.” 

Fig. 2.1 illustrates 
the distribution curve 
for the J-shaped distri¬ 
bution of Table 1.2, and 
Fig. 2.2 that for the 
unimodal symmetrical 
distribution of Table 1.7. 

A freehand curve has 
been drawn in both 
cases. 

Curves of this kind 
can be used to deter¬ 
mine the quantiles. In 
fact, to find the median, 
we merely have to find 
the abscissa correspond¬ 
ing to the ordinate iV/2, 



(Heights yhown lo correspond to crdncs )n the Tabl<% e.g. cumulated 
frequency at 64 mclios is the fiiHjuoncy up to ami including the range 
04- and thcrcfoio up to 64^ inches ) 
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and so on. The positions of the quartiles and the median are shown in Fig. 2.2, and 
the reader may care to compare the values obtained by reading the graph by eye with 
those given in Example 2.5. 

Measures of Dispersion^ 

2A4, We now proceed to consider the quantities which have been proposed to 
measure the dispersion of a distribution. They fall into three groups :— 

(a) Measures of the distance (in terms of the variate) between certain representative 
values, such as the range, the interdecile range or the interquartile range. 

(b) Measures compiled from the deviations of every member of the population from 
some central value, such as the mean deviation from the mean, the mean deviation from 
the median, and the standard deviation. 

(c) Measures compiled from the deviations of all the members of the population among 
themselves, such as the mean difference. 

In advanced theory the outstandingly important measure is the standard deviation ; 
but they all require some mention. 

Range and Interquaniile Differences 

2.15. The range of a distribution is the difference of the greatest and least variate- 
values borne by its members. As a descriptive parameter of a population it has very little 
use. A knowledge of the whereabouts of the end values obviously tells little about the 
way the bulk of the distribution is condensed inside the range ; and for distributions of 
infinite range it is obviously wholly inappropriate. 

More useful rough-and-ready measures may be obtained from the quantiles, and there 
are two such in general use. ''fhe interquartile range is the distance between the upper 
and lower quartiles, and is thus a range wliich contains one-half the total frequency. 
The interdecile range (or perhaps, more accurately the l-9th interdecile range) is the distance 
between the first and the ninth docile. Both these measures evidently give some approxi¬ 
mate idea of the “ spread ” of a distribution, and are easily calculable. For this reason 
they are fairly generally used in elementary descriptive statistics. In advanced theory 
they suffer from the disadvantage of being difficult to handle mathematically in the 
theory of sampling. 

Mean Deviation^^ 

2.16. The amoxmt of scatter in a population is evidently measured to some extent 
by the totality of deviations from the mean. We have seen (2,5) that the sum of these 
deviations taken witli appropriate sign is zero. We may however write 

5, = f \x - fH\dF .(2.13) 

J —00 

where the deviations are now taken absolutely, and define dt to be a coefficient of dispersion. 
We shall call it the mean deviation about the mean. 

Similarly for the median we may write 

^2=1* I ^ ! dF ..... (2.14) 

J —00 

and call 5, the mean deviation about the median. 

In future the words mean deviation alone will be taken to refer to the mean 
deviation about the mean. 
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Both these measures have merits in elementary work, being fairly easily calculable. 
Once again, however, they are practically excluded from advanced work by their intracta¬ 
bility in the theory of sampling. 

Standard Deviation 

2.17. We have seen that the mean about an arbitrary point a is given by 

//i “I {x — a) dF, 

J —00 

We may, by analogy with the terminology of Statics, call this the first moment, and define 
the second moment by 

{x—aydF .(2.16) 

J —oo 

The second moment about the mean is written without the prime, thus: 

(x - MiVdF .(2.16) 

J - 00 

and is called the Variance. The positive scpiare root of the variance is called the standard 
deviation, and usually denoted by a, so that we have 

= " f * a //^2 • • • • ( 2 * 17 ) 

The variance is thus the mean of the sqvures of deviations from the mean. The device 
of squaring and then taking the square root of the resultant sum in order to obtain the 
standard deviation may appear a little artificial, but it makes the mathematics of the 
sampling theory very much simpler than is the case, for example, with the mean deviation. 

The calculation of the variance and the standard deviation proceeds by an easy 
extension of the methods used for the moan. In particular, if h is some arbitrary value 

//2 (about a) = { (x — a^dF 

J — or 

= [ + 2(6 a)(x — 6) -t- (b — a)^}dF 

J —QC 

-- //y (about 6) -f 2(6 — a)fi\ (about 6) -t (6 — a)^ , (2.18) 

If now 6 is the mean we have 

^2 4 - — ay 

or - Uh - ay ^ ... (2.19) 

Thus the variance can easily bo found from the second moment about an arbitrary point, 
which can be selected to simplify the calculations. 


Example 2.6 

To find the mean deviation and the standard deviation for the distribution of men 
according to height considered in Example 2.1 (Table 1.7). 

In the case of the mean deviation for a grouped distribution, the sum of deviations 
should first be calculated from the centre of the class-interval in which the mean lies and 
then reduced to the mean as origin. It so happens that in Table 2.1 the mean fell in the 
interval taken as origin, so that the preliminary arithmetic already exists in the Table. 

The sum of positive deviations is 8763 and that of negative deviations ^ 8584. 
Hence the sum of deviations regardless of sign is 17.347, the unit being the class-interval 
and the origin the centre of the interval. 
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To reduce to the mean as origin, we note that if the number of observations below 
the mean is Ni and the number above the mean is and d = — a, we have to add Nid 

to the sum of deviations about the centre of the interval and subtract N^d, In this case 


d ^ 0*02 (Example 2.1), Ni 
Hence the mean deviation 


4918, ^ 366 

_ 17,347 4 - 25 
' 8585 


Hence we add (4918 - 3667)0 02 = 25. 


2 02 inches. 


For the standard deviation some further calculation is required, as shown in Table 2.2. 


TABLE 2.2 

Calculation of the Standard Deviation for the Distribution of Table 1.7. 
(Some preliminary calculation already carried out in Table 2.1.) 


. - 

— _ 

-- 

-— _— _ — 

(J) 

(2) 

(,3) 

(4) 

Htiight, 

Froquoncy 

Deviation 


inches. 

/. 



57- 

2 

- 10 

200 

58- 

4 

- 9 

324 

59- 

14 

- 8 

896 

(iO- 

41 

- 7 

2,009 

61- 

83 

- 6 

2,988 

62- 

169 

- 5 

4,225 

63- 

394 

- 4 

6,304 

04- 

669 

- 3 

6,021 

65 ~ 

990 

- 2 

3,960 

66~ 

1223 

- 1 

1,223 

67- 

1329 


0 

68 ~ 

1230 

1 » 1 

; 1,230 

69- 

1 1063 

t ^ ! 

i 4,252 

70" 

, 646 

3 

5,814 

71- 

1 392 

1 4 

1 6,272 

72- 

202 

1 

5,050 

73 

79 

6 1 

2,844 

74- 

32 

7 

1,568 

75- 

16 

1 B 

1,024 

76 

6 

9 

405 

77- 

1 ^ 

30 

200 

Totals 

8585 

1 

i ^ 

56,809 

_ __ 1 

1 


__ _ _ 


Column (4) shows the sum where/is the actual frequency. We then have, for 

the wsecond moment about the arbitrary origin 


56,809 


^‘ 8585 

We have already found in Example 2.1 that 

179 

a. — a =-= ( 

8585 


= 6-6172. 


00209. 
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Hence, in virtue of (2.19) 

= 6*6172 ~ ( 0 * 0209)2 
= 6*6168 

a = == 2*57 inches. 

It may be noted that the mean deviation is about 80 per cent, of the standard deviation. 
This relationship often holds approximately for unimodal curves approaching symmetry. 
The reason will become apparent when we study the so-called normal distribution in 
Chapter 5. 


Example 2.7 

To find the variance of the distribution 

(IF “ .(I - dx, 

B{p. q) 


0 < X 


We have, about the origin, 


= ^ ' r 

B{'P, 5')J 0 


(1 — ^ dx 


_ B(p, q -+ 2 ) ^_ (q + \)g^ 

JHP^ <?) (?> + ? + i)(p -I- <7)’ 

We have already found (Example 2.2) that 


Thus 


' p q 

//2 = /^i - 


(v 4 - q -f i)(p + q) (p -f qV 
pq 

(v + q -! ^)(p + qY' 


Sheppard^s Corrections 

2.18. The treatment of the values of a grouped frequency-distribution as if they 
were concentrated at the mid-points of intervals is an appioximation, and in certain 
circumstances it is possible to make corrections for any distortion introduced thereby. 
These so-called Sheppard's corrections ’’ will be discussed at length in the next chapter, 
but at this stage we may indicate without proof the appropriate correction for the second 
moment. 

If the distribution is continuous and has high order contact with the variate-axis 
at its extremities, i.e. if it tails off ” slowly, the crude second moment calculated from 
grouped frequencies should be corrected by subtracting from it A 2 /12, where h is the width 
of the interval. For example, in the height data of Example 2.6, we have 4 = 1, and the 
corrected second moment is 

6*6168 - 0*0833 = 6*5335. 

The corrected value of a is = 2*56, as against an uncorrectcd value of 2*57. 
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Mean Difference 

2.19. The coefficient of mean difference (not to be confused with mean deviation) 
is defined by 

-d i = f [ I »• — 2/1 dF{x) dF{y) 

J — 00 J —00 

■= f f \ — y \ ffy) dx dy .... (2.20) 

J - at J —-00 

In the discontinuous case two different formulae arise. We have either 

"" NXN^ 1) X" ') 7- k . ■ (2.21) 

'' 'y-T-ooA.-™^ —QO 

the mean difference without repetition, or 

m Z Z • • • (2-22) 

) —(Xij— tXi 

the mean difference with repetition. The difference lies only m the divisor and is 
unimportant if N is large. 

The mean difference is the average of the differences of all the possible pairs of variate- 
values, taken regardless of sign. In the coefficient with repetition each value is taken 
with itself, adding of course nothing to the sum of deviations, but resulting in the total 
number of pairs being In the coefficient without repetition only different values are 
taken, so that the number of pairs is N{N — 1). Hence the divisors in (2.21) and (2.22), 


2.20, The mean difference, v^hich is due to Gini (1912), has a certain theoretical 
attraction, being dependent on the spread of the variate-values among themselves and 
not on the deviations from some central value. It is, however, more difficult to compute 
than the standard deviation, and the appearance of the absolute values in the defining 
equations indicates, as for the mean deviation, the appearance of difficulties in the theory 
of sampling. It might be thought that this inconvenience could be overcome by the 
definition of a coefficient 

f \ (^ ~ yYdF(x)dF{y), 

J -ooj x > 

This, however, is nothing but twice the variance 


dF(x)dF{y) {x^ 





— 2/<j^ 


r dF{x)r y^dF(y) 

J —00 J —00 


== 2/^2 . . ( 2 . 23 ) 

This interesting relation shows that the variance may in fact be defined as half the 
mean square of all possible variate differences, that is to say, without reference to deviations 
from a central value, the mean. 
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Coefficients of Variation: Standard Measure 

2.21, The foregoing measures of dispersion have all been expressed in terms of units 
of the variate. It is thus difficult to compare dispersions in different populations unless 
the units happen to be identical; and this has led to a search for measures which shall 
be independent of the variate scale, that is to say, shall be pure numbers. 

Several coefficients of this kind may be constructed, such as the deviation 

mean 

mean deviation 

—median Only two have been used at all extensively in practice, Karl Pearson s 

coefficient of variation, defined by 


V = 100-^,.(2.24) 

/^i 

and (Hni’s coefficient of concentration, defined by 


G - 


/I I 


(2.25) 


Both tliese coefficients suffer from the disadvantage of being affected very much by 
the value of the mean measured from some arbitrary origin, and are hardly Ruiiable for 
advanced v^ork. 


2,22. For our purposes, comparability may be attained in a somewhat different way. 
Let us take o itself as a new unit and express tne frequency function in terms of a new 
variable ^ related to x by 

^ .(2.26) 

a 

Any distribution expressed in tliis way has zero mean and unit variance. It is then said 
to be expressed in standard measure. Two distributions in standard measure can be readily 
compared in regard to form, skewness, and other qualities, though not of course in regard 
to mean and variance. 


Co?f cent ration 

2,23. Gini’s coefficient of concentration arises in a natural way from the following 
approach :— 

Writing, as usual 

Fi^i = f’ f(x)<Jx .(2.27) 

J —ao 

let US define 

0(x) = xf(x)dx ..... (2.28) 

/hJ -00 

0(a;) exists, of course, only if exists. Just as F{x) varies from 0 to 1, 0{x) varies from 
0 to 1 provided that the origin is taken to the left of the start of the frequency-distribution, 
which we shall assume to be so. 0{x) may be called the incomplete first moment. 

Now (2.27) and (2.28) may be regarded as defining a relationship between the 
variables F and 0 in terms of parametric equations in a;.* The curve whose ordinate 

* Hie definition of curves by parametric equations will be found treated in most textbooks of 
differential calculus. The term “ parameter in this connection is usual in mathematics, but is not 
to bo confused with the more special statistical parameter as defined in 2.2. 
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and abscissa are 0 and F is called the curve of concentration. Such a curve is shown 
in Fig. 2.3. 



The curve of concentration must be convex to the i^-axis, for we have 

, d0 _ xf(x) 


dF f(x) 

which is positive since our origin is taken to the left of the start of the distribution. 

positive. 


dF^ ~ dF 


1 

fir) 


Thus the tangent to the curve makes a positive acute angle with the F-axis, and tiie angle 
increases as F increases ; in other words, the curve is convex to the F-axis. 

The area between the concentration curve and the line F 0 is called the area 
of concentration. We proceed to show that it is equal to one-half the coeiticient of 
concentration. 

In fact, we have from Fig. 2.3 


0dF 


and thus 


2 (area of concentration) — f F d0 — f 

Jo Jo 

(area) j* F{x)x dF{x) — //, f 0{x) dF(x) 

J —QC J JO 

=. f .rrfF(a-)f' dF{y)- f y dF{y) 

J —00 J — an J ao J —oo 

= f f i-r ~y) dF(x) dF(y). 

^00 /.qO ^ Xj J - aO 

Now 1 {x — y) dF(x) dF{y) = 0, and hence 

J —tKi J — OO 

Q Xj pCO pOO 

(ar - «/) dF(x) dF(y) + (y - ^) <fF{x) dF{y) 

—ooj—Qo J --0O J jr J 

-if r \^-y\ m^)dF{y) 

J —00 J ~O0 

2 • 
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Thus 


area of concentration = i the coefficient of concentration. 


2.24, Various methods have been given for calculating the mean difference. The 
following is probably the simplest, particularly for distributions specified in equal group- 
intervals. 

Let us. without loss of generality, take an origin at the start of the distribution. We 
may then write 

oo go 

X* I ^7 -^k\ = - a-j.) 

1-1 

the summation U' being taken over values such that j k. We have Iso 
~ + (^;_1 - - 2 ) 4 - . . . !- - ‘^ a )* 

y i 

r(x^ - Xft) =- 2^ 5 - x,,) 

A 1 

wliere 6’,, is the number of terms of type (x^ — x^.) in 2/' containing ^ ^ Since k is 

the number of values of / less tlian or equal to h (the origin being at the start of the dis¬ 
tribution) and N - - h the number greater than or equal to A - 1 ^ 1, we have (7^ =-- h(N — h), 
and thus 

■'i -•»/,) 


2 

.(^-29) 

h I 

lliis form is particularly useful if all Ihc* intervals are equal. being the distribution 
function of Xj^ we then have 

A 1 
A - I 

- 2 2^>,.(i -n).(2.:«)) 

h-1 

If the actual cumulated frequency for Xl^ is we have 

-O^) .(2.31) 

A -1 

the most convenient form in practice. 


Example 2,8 

Returning once more to the height distribution considered in ]>revious examples, we 
may calculate I!Gf^{N — Oh) as in the Table overleaf. 
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TABLE 2.3 

Calculation of the Mean Difference for the Height Distribution of Table 1*7. 


Height, 

incheR. 

Frequency, 

__ _ 

N -O, 

0,{N ^ G,) 

,57™ 

2 

2 

8583 

17,166 

58™ 

4 

6 

8579 

51,474 

59- 

14 

20 

8565 

171,300 

60- 

41 

61 

8624 

619,964 

61- 

83 

144 

8441 

1,216,504 

62- 

169 

313 

8272 

2,589,136 

63- 

394 

707 

7878 

5,669,746 

64- 

669 

1376 

7209 

9,919,684 

65- 

990 

2366 

6219 

14,714,154 


1223 

3589 

4996 

17,930,644 

67- 

1329 

4918 

3667 

18,034,306 

68- ! 

1 1230 

1 6148 

1 2437 

14,982.676 

69- i 

i 1063 1 

1 7211 

1374 

9,907,914 

70- 1 

646 

7857 1 

1 728 

5,719,896 

71- 

392 

8249 1 

1 336 

2,771,664 

72- 

' 202 

8451 

134 

1,132 434 

73- 

1 79 1 

1 8530 

55 

469,150 

74- 

32 

8562 

23 

196,926 

75- 

16 

1 8578 i 

7 

60,046 

76- ’ 

5 

i 8583 

2 

17,166 

77- ^ 

2 

8585 

i ' 

— 

Totals 

1 ' 

85S5 

1 ~ 


105,990,860 


We have, from (2.31), for the mean difference with repetition, 

. 2 X 105 , 990,850 

== 

85852 
— 2-88 inches 

as against a mean deviation of 2*02 inches and a standard deviation of 2*57 inches (Example 
2.6). There is, of course, nothing inconsistent in the difference between these values. 
The coefficients are different in nature, and there is no reason why their numerical values 
in any particular case should approach equality. 


NOTES AND REFERENCES 

The relationship between mean, median and mode expressed in equation (2.11) was 
discussed from the mathematical point of view by Doodson (1917), who showed that it 
holds as a first approximation for continuous distributions deviating only moderately from 
symmetry. 

It was shown by Dunham Jackson (1921) that the indeterminacy in the definition of 
the median can be removed by a more sophisticated mathematical approach. He showed 

N 

that for N values Xi . , . Xjy the sum ^ \ considered as a function of f, has 
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a minimum for some unique if > 1 ; and further that as p-^ 1, fp tends to some 
unique value, which may be defined as the median. 

The proof of the increasing character of the function F{t) of 2.7 is due to Norris (1935), 
who gives references to earlier proofs. 

The work of the Italian school on concentration does not appear to have been treated 
in English books. The fundamental memoir is that of Gini (1912), who has returned to 
the subject in subsequent papers, many of them in Metron. For methods of calculating 
the mean difference, see de Finetti and Paciello (1930). 


de Finetti, B., and Paciello, U. (1930), “ Sui metodi proposti per il calcolo della differenza 
media,” Metron, 8, part 3, 89. 

Doodson, A. T. (1917), “Relation of Mode, Median and Mean in F^-oquency Curves,” 
Biometrika, 11, 425. 

Gini, C. (1912), “ Variability e Mutabilita,” Studi Econondco-Giuridici della R, Universitd 
di Cagliari, Anno 3, part 2, p. 80. 

Gini, C., and Galvani, L, (1929), “ T)i taluni estensioni dei concetti di media ai caratteri 
qualitativi,” Meircrn, 8, parts 1-2, 3. 

Jackson, Dunham (1921), “Note on the median of a set of numbers,” Bull. Amer. Math. 
Soc., 27, IGO. 

Norris, Nilan (1935), “ Inequalities among averages,” Ann. Math. Stats., 6, 27. 


I EXERCISES 

J 2.1. Show that th(' mean deviation about an arbitrary point is least when that point 
is the median. 


2.2. Show that the mean (about the origin) of the discontinuous distribution whose 
frequencies at 0, 1, 2, . . . r, . . . are 


1 !’ 




2 !' 



is m, and that the variance is also in. 

2.3. vShow that, if deviations are small compared with the value of the mean, we 
have approximately, for the Geometric* and Harmonic means, 



and hence that 

ji/, -20 

2.4. Show that the mearli deviation about the mean is not greater than the standard 
deviation. 


2.5. Show that for the “ rectangular ” population 

dF — dx, 0 < a: < 1 
(about the origin) ~ \ 
/^2 ~ 1^2 
mean deviation == J 
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2,6. Show that for the distribution 

£. 

dF y^e dx, 0 < X < cc 

the mean, standard deviation and mean difference are all equal to a ; and that the inter- 
qu|artile range is a log^ 3. 


! 2.7, s: 


Show that for the distribution 


X* 


dF=y^e~^^yJ ^ dy, 0 ^ % o:) 

/ii (about the origin) =- r(^' 


2.8. Show that if a range of six times the standard deviation contains at least 
18 class-intervals, Sheppard’s correction will make a difference of less than G o per cent, 
in the uncorreoted value of the standard deviation. 

2.9. Show that for a continuous distribution 


d,^2{ F(a;){l - F(x)}dx. 

J — OfJ 


2.10. If the variate-values of a distribution arc u ^ in asceiuling order of‘ 

magnitude and 


/ 1 

K ^ -y + I 


}~ 1 


i I 




-^,{.V(.V + 1)//, -2U]. 


then 



CHAPTER 3 

MOMENTS AND CUMULANTS 


Defi7ntion of Moments 

3.1. In the previous chapter we defined the first moment (arithmetic moan) about 

an arbitrary point a by the Stieltjes integral 

Ijl\ “1 (r — a)dF . 

J oe> 

. (3.1) 

and the second moment about the point by 

^ oo 

1^2 “ J — eiydF. 

. (3.2) 


In generalisation of these equations we may dotino a series of coefficients , r = 1, 2 . . 
by the relation 

/q - j (j- ~ uYilF. .... (3.3) 

fji]. is called the moment of order r about tlie point a. When a is the inean we write 
the moment without the prime, 

j .(>i *) 

Tn f)artieular 


//i 0, 

and \\(} may also define a momeni of zero order 

/‘o = ^ j =" f • 

It is assumed that when reference is made to the rth moment of a ]>articular distribution, 
the appropriate integral (3.it) converges for that distribution. As will be seen later, some 
of the theoretical distributions encountered in statistics do not possess moments of all 
orders ; some, in fact, pos8(‘SS only a few moments of low order, and one or tw^o do not 
possess any, except of course the moment of order zero. 


3.2. Jf a and b are two variate-values, let b — a v and denote the moments about 
a and 6 by //'(r/) and //'{6) respectively. Then we have, by the binomial theorem, 

(.r - ay ^ {? ~ b b ay ~ (r ~ b -i- cy 


Hem 


\(x - by 


- I e - »y<iF 


i:GH; 


^ by-UIF 


Alfr^yb) & 


(3.5) 


J -0 


A.S. 
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This equation gives the Hh moment about a in terms of the rth and lower moments About 
6 , It may be written in a symbolic form which will be found to provide a useful mnemonic, 
namely 

i“r(«) = {/«’(*) + 

with the convention that the expression on the right is to be expanded binomially and 
the form {f 4 '(b)y replaced by 

The equation (3.5) is of particular importance if one of the values a or 6 is the mean 
of the distribution. In this case we have 




. (3.6) 


~ 'y'.i (” t^l)' 

. (3.7) 

In particular 



4 + 1 

4 = y“a + + ju'i® > • 

fi\ — //, + + 6//', Vs 

. (3.8) 

and 

/'s == 4 - 1 

Hi = fh - Vi/4 + 2//J® > . 

. (3.9) 


/U == Mi - - ^Mi\ 


Calculation of Moments 

3.3. For a distribution specified numerically in a frequency table the calculation 
of moments of third and higher orders is akin to that of the first and second moments. 
For grouped data (high order moments arc hardly ever required for ungrouped data) the 
observations are regarded as concentrated at the mid-points of intervals ; a convenient 
arbitrary origin a is chosen, the moments about a calculated, and then if necessary the 
moments about the mean are ascertained from (3.6) or (3.7). The effect of grouping may 
bo connected for in certain cases. 

In practice numerical moments of order higher than the fourth are rarely required, 
being so sensitive to sampling fluctuations that values computed from moderate numbers 
of observations are subject to a large margin of eiTor. 

There are two methods in general use for arriving at the moments about an arbitrary 
origin. The first is an immediate generalisation of the methods used in Chapter 2 for the 
first two moments. The second will be considered in 3.10 in connection with factorial 
moments. 

Example 3,1 

To find the first four moments about the mean of the distribution of Australian 
marriages of Table 3.8. 

Until the last stage we work in units of three years, the variate interval. A working 
mean is taken at 28-5 years. To check the arithmetic we use an identity of type 

{x 4- 1)^ = a:® -b -f 3a: + 1 

(a; + 1)^ = 04 4- -f Ox^ 4 . 4a; + 1. 
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Thus, for instanoe, the value of + I)*" is found in addition to that of g(x)x'' and the 

two checked by identities such as 

Eg(x){x 4- 1)® = rg{x)x^ + ^Eg{x)x^ + ‘Ai:g(x)x + Egix), 
g{x) being the actual frequencies. The arithmetic work is shown in Table 3.1. 


TABLE 3.1 

Calculation of the First Four Moments of the Distribution of Marriages of Table 1.8. 


Mid. 

value 

of 

Inter- 

9’ 

X, 

X(J. 

! 

(a:-f 1)<7 

x^g 


1 

{x-\ l)^t/ 


(r^ 1)*». 

vals» 

Years. 

16*5 

294 

__4 

~ 1,176 

- 882 

4,704 

2,616 

- 18,816 

- 7,938 

75,264 

23,814 

19-5 

10,995 

-3 

- 32,985 

-21.990 

98,955 

43,980 

-296,865 

- 87,960 

890,596 

175,920 

22*5 

61,001 

-2 

-122,002 

-61,001 

244,004 

61,001 

488.008 

- 61.001 

976,016 

61,00) 

26r> 

73,054 

-1 

- 73,054 

-83,873 

73,054 

-- 

- 73,054 

-156,899 

73,054 


28-5 

56,501 

0 

-229,217 

56,501 

- 

56,501 

- 876,743 

66,501 

-- 

56,501 

31-5 

33,478 

1 

33,478 

66,956 

33,478 

133,912 

33,478 

267,824 

33,478 

535,648 

34-5 

20,569 

2 

41,138 

61,707 

82,276 

185,121 

164,.>52 

555,363 

329,104 

1,066,089 

37-5 

14,281 

3 

42,843 

57,124 

128,529 

228,496 

385,587 

913,984 

],]5(),761 

3.655,936 

40*r> 

9,320 

4 

37,280 

46,600 

149,120 

233,000 

696.480 

1,165,000 

2,385,920 

6,825,000 

43-5 

6,236 

5 

31,180 

37,416 

155,900 

221,496 

779,500 

1,346,976 

3.897,500 

8,081,856 

4(i-5 

4,770 


28,620 

33,300 

171,720 

I 233,730 

1,0,30.320 

1,636,110 

6,181,920 

11,^62,770 

49*5 

3,620 

7 

25,340 

28,9(>0 

177,380 

231,680 

l,241,6(i0 

1,853,440 

8,691,620 

14,827,520 

52*5 

2,190 

8 

17,520 

19,710 

140,160 

177,390 

1,121,280 

1,596,510 

8,070,240 

14,368,690 

55*6 

1,655 

9 

14,895 

16,550 

131,055 

165,500 

1,206,496 

1,655,000 

10,858,465 

16,650,000 

58*6 

1,100 

10 

11,000 

12,100 

110.000 

133,100 

1,10(),(X)() 

1,464,100 

11,000,000 

11,859,210 

16.105,100 

51*5 

810 

11 

8,910 

9,720 

98,010 

116,640 

1,078.110 

1,399,680 

1(5,796,160 

54*5 

649 

12 

7,788 

8,437 

93,456 

109,681 

1,121,472 

1,425,853 

13,467,664 

18,536,089 

67 5 

487 

13 

(>,331 

6,818 

82,303 

95,152 

1,069,939 

1,336,328 

13,909,207 

18,708,692 

70*5 

326 

14 

4,564 

4,890 

63.896 

73,350 

894,544 

1,100,260 

12,523,610 

1(5,503.750 

73*5 

211 

15 

3,165 

3,376 

47,475 

54,016 

712,125 1 

864,266 

10,681,875 

13,828,096 

70*5 

119 

16 

1,904 

2,023 

30,464 

34,301 

487,424 

584,647 

7,798,784 

9,038,999 

79*5 

73 

17 

1,241 

1,314 

21,097 

23,652 

358,649 

425,736 

6,097,033 

7,663,248 

82*6 

27 

18 

486 

513 

8,748 

9,747 

157.461 

185,193 

2,834.352 

3,518,667 

86*5 

14 

19 

266 

280 

5,054 

6,600 

96,026 

112,000 

1,824,494 

2,240,000 

88*5 

5 

20 

100 

105 

2,000 

2,205 

40,000 ' 

! 

46,305 

800,000 

972.406 

Totai.9 

301,785 

- 

318,049 

474,190 

2,155,838 

2.635,287 

13,675,105 

1 

19,991.056 1 

137,30(>,162 : 

1 

202,091,761 


From this table we find 

E(xg) = 88,832 

2>V) = 2,15r>,838 

E{x^(j) = 12,798,362 

E{Dg) -= 137,306,162. 

The values will be found to check and we have, about the working mean, on dividing by 
the total frequency 301,785, 

= 0-294,365,253 

= 7-143,622,115 

= 42-408,873,807 
= 464-980,075,219. 
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For the moments about the mean, substitution in equations (3.9) gives 

==. 7*056,977 

36*151,595 
= 408*738,210. 

These are expressed in class-intervals, which are units of three years. To express the 
results in units of one year we multiply the rth moment by 3^“, f\g. 

7*056,977 X 9 -- 63-512,79. 

3.4. If a distribution is specified mathematically the determination of moments is 
equivalent to the evaluation of certain sums or integrals. It is usually necessary to con¬ 
sider whether the moments exist. Some examples will illustrate the general principles 
involved. 

Example 3.2 

Consider the so-called binomial distribution (q -j- p)^ in which the frequencies of 
values 0, /i, 2A, . . . are the successive terms in the expansion of the distribution, i.e. are 

* • • Taldng an origin at the first term and working in units 




of we have 


which may be written 




q^^" ^ j 




»p{fl I- pV 


=I lO” 

- np{q I p)" ' ^ > 1(11 ^)]>Hg -4 />)«-- 

-- fi-p^ f itpq. 


//g ^ npq. 


Similarly 


’ d 


etc., and it will be found that 

^. Npq(q - p) 

//, llp^qi^ih^ ^ 'pq7i{l Gpq). 

Example 3.3 

Consider the distribution 


(1 -f x^Y 


— OO X 00 

tn ^* 1. 
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This is a unimodal distribution symmetrical about a- = 0. All existent moments of odd 
order about the origin therefore vanish. The constant k is given by the equation 

J -00 (1 + a-*)'" 

_ ^mn-rn- 4) 

r(7n) 

The moment about the mtmn of order 2r, if it exists, is given by 

/.r ; 

U2r = 

and tliis integral converges if and only if 

27n 2 t ~\ 1 . 

Thus the moments about the origin of order ^ (2m 1) exist and those of higher order 

do not. 

If m = 1 it may he noted that the integral f ^ is not completely convergent, 

r Icjc dx 

I -does not exist, although the principal value 

J »(1 f •r-') 

f" kx dx 

does exist and is ecpial to zero. It is a matter oi convention whethei we regard the dis¬ 
tribution as possessing a mean in this case. For m 1 the mean exists and is located at 
the origin. 

MaJdng the substitution ^ | ^ ~2 formula for 


i.e. 


lim 

/ w' 


lira 


^ /*■[ 

J 0 


(1 


» z'’< ' - dz 


^ r{r + l)l\m - r - \) 

r{w) 


and on suV)stitnting for k. 


rlnr. » ' '■ 

Example 3.4 

Consider the “ normal ” distribution 

1 _ 

dF = e d r — oo '' x cc. 

(yV27t 

This is symmetrical about the origin. All moments exist, those of odd order vanishing. 
Thus 




This may be evaluated by partial integration, but a more direct method is as follows : 
Consider the integral 

1 

<T\/(27t)j 



u 
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We have, for alJ real values of t 


pj 2a* 



xr e 



The series on the right is uniformly convergent in x and may be integrated term by term 
if the rcisulting series is uniformly convergent. We then have 


M{t) 


m- 


In other words, is the coefficient of in and hence 




<T2'*(2r)! 

2'* r! 


Mofuent-generating Functions and Characteristic Functions 

3.5. The previous example shows that in some cases we can derive from the dis* 
tribution or the frequency function a function M(t) which, when expanded in powers of 
t, will yield the moments of the distribution as the coefficients of those powers. Such 
a function is accordingly called a Moment-generating P^unction. It will be discussed more 
fully in the next chapter. 

For many frequency functions the integral 1 e^^dF or the sum E{e!^)f(Xj)} may 

J 00 

not exist for real values of t. This is, for example, true of the function dF ^ h( 1 f dx 

for finite positive values of m, A more serviceable auxiliary function is 

“ f (IF (t real) ..... (3.10) 


This is known as the Characteristic Function and is of groat theoretical importance. It 
will be seen in Chapter 4 that under certain general conditions the characteristic function 
determines and is completely determined by the distribution function. It also yields 
many valuable results in the theory of sampling. 

Since by the nature of the distribution function the integral I dF converges, 

J — 0& 

I 7(0! ' f \^'‘^\dF < 1 

J —QiLi 


and hence the Stieltjes integral (3.10) converges absolutely and uniformly in t. It may 
therefore be integrated under the summation signs with respect to t, and may be differ¬ 
entiated provided that the resulting expressions exist and are uniformly convergent. We 

have, for example, writing Df for 

J --0O 

and hence, putting t ™ 0, 


fir ^ .( 3 . 11 ) 

provided that fx^ exists. If <p(t) be expanded in powers of t, ft], must thus be equal to the 

iity 

coefficient of --j' in the expansion. Thus the characteristic function is also a moment¬ 
generating function. 
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Example 3.5 

Consider again the binomial {q + p)^. Taking h as unit, we have 


Hence 


v(.t) = ^ {(y ^ 

= (9 + pe«r. 
ft - (- 


and so on. 


= np -{ n(n — l)p^ 


Example 3.6 

Consider the distribution 


dF - --- .TV 

r{y) 


a > 0, y > 0 
0 < X V oo 


which is known as Pearson’s Type 111 (cf. (Chapter 6). The distribution may have a variety 
of shapes, depending on the value of y, but moments of all orders exist in virtue of the 

convergence of the integral 1 r/.r, the /^-function integral. We have then, for the 

J 0 

characteristic function, 

(p(t) = ('(><'< -“■* xy- * (lx. 

F(y)Jo 


By the substitution ==^ x(a - it) this becomes 

ay 

r{y){a 

1 


W) 




a-' d: 


.!„« r 

J 0 

Hence 


(■ --»)'■ 


I 


dz = r{y) whether 2 : is real or complex. 


/Wl 


y 

a 


_ y^y + 

/^2 - — 




f _ y(y d" l)(y d~ 


and thus 
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and so on. In particular, 


2y 

//3 == 


Absolute Moments 


3,6. The quantity 



a \ ^ (IF 


(3.12) 


is called the absolute moment of order r about a. The absolute moments about the moan 
are written without primes. 

If r is even, the absolute moment is clearly equal to the ordinary moment, and if the 
range of the distribution is positive the absolute moments about any point to the left of 
the start of the distribution are equal to the ordinary moments of corresponding order. 

There are some interesting inequalities concerning the absolute moments. Referring 
to the function E{t) of 2.7 and remembering that it is a non-decreasing function of t. we 
find, on putting / 0, 1, 2, . . that 

(»'i)' ■ (*'2)^ (’’3) • • • W • ■ .• • • 

A more general inequality, due to Liapounoff, is 

v\;^ ' : a y b ^ r K) . . . . (3.1+) 

A proof of this result is sketched in Exercise 3.14. In particular, jiutiing h — c) 

we find 


vl.v[ . . . . . . (3 lo) 

Further, putting r/ 0 in (3.14) we find 


1 i 

or r/ Vf/', c b 

which is equivalent to (3.13). 


Fa r toria I Mow e7i is 

3.7. The factorial expression 

if(.r h){x - 2h) . . . (.r t - Ih) 

may conveniently be written a notation which brings out an analogy with the power 
Taking first differences with respect to x and with unit k, we have 

“ {x 4 7/)^'^ 

= {x 4- h)x{x ~~ h) . . . {x — r ~ 2h) — x(x — h) {x — r - ih) 

=- rx^^” 

which may be compared with the differential equation 

da:* r= rx*^^ dx. 

1 


Conversely 


Z '"' 


{r 4- 1)A 


(X f h ) 


u + l\ 


X* dx 


— .r 


1 


r -f 1 


corresponding to 
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The rth factorial moment about an arbitrary origin may then be defined by the equation 

- a)'^\f{x,) .(S.lfi) 

;•«—oc 

where we ha.ve chosen the summation sign E rather than the Stieltjes integral because 
it is almost entirely for discontinuous distributions, or continuous distributions grouped 
in intervals of width that the factorial moments are used. In statistical theory they 
are not very prominent, but in the theory of interpolation and of curve fitting they are 
sufficiently important to justify some mention of their proj)erties. 

As usual, when it is necessary to distinguish between factorial moments about the 
mean and those about an arbitrary ]:)oint we may write the former without the prime. 


3.8. The factorial moments obey laws of transformation similai to those of equation 
(3.5) goveriiing ordinary moments. In fact we have the expansion •* 


and hence 


{(I -f- 5)^^^ 


ic). 




(.r b \ where r 



^ \)] 


and hence 

which may be written symbolically 





(3.17) 


3.9. By direct expansion of (3.16) it is seen that 

//pj = 

/^[2J “ ; 

== /h ~ t- 

//jjj - 6^74 - 6/iV; ^ 

and conversely that 

, 1 

/^{ ^ fhM ^ r 

/<! /^[4) h///q-53 -f Vl]]j 


. (3.18) 


. (3.19) 


Since the first moments are equal the equations remain true when the primes are 
dropped and terms in first moments omitted. 


♦ It is clear that (a + will be a polynomial of degree r in a, and may therefore be equated 
r 

to ^ ^ Icj where the ifc’s are polynomials in 6 and h but do not contain a. Putting a — 0 we 

7—0 

obtam -= kr. Taking first differences with respect to a and putting: o ^ 0 we obtain 
Successive differences give the and the above result follows. 
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It is possible to give general formulae showing the factorial moments about one point 
in terms of the ordinary moments about another, and vice-versa. In fact 

} ■ • • (3.20) 

ftr](a) = I • • • (3.21) 

where B^^\x) is the Bernouilli polynomial of order 7i and degree r in x, defined as the . 
coefficient of ^ in (^ ^ j For a discussion of these polynomials and the derivation 

of equations (3.20) and (3.21) reference may be made to Frisch (1926). 

Calculation of Factorial Moments 

3.10, The calculation of factorial moments for grouped data may be effected by a 
process of progressive summation which is illustrated in Table 3.2. 


TABLE 3.2 


(I) 

(2) 

( 3 ) 

( 4 ) 

Frequency. 

First Summation. 

Second Summation. 

Third Summation. 

A 

fa 

J3 

/l+ • • • ~^fn 

ft~^ • • Vfrt 

^ 3 + ... +/« 

{n-\)Sn 

/a+ 2/4 4 - . . . (n— 2 )f„ 


u 

A f/6+ • • • '^fn 

f\^ • » 3 )A 



/rt-2+/«-J “f/rt ; 

j -j- 2 Jn 

A-2 + 3A^,-I-6/„ 

fn~ 1 


fn f 2A 

fn— 1 4 ' 3 /n 

/« 

fn 

1 

fn 

-- 

— 

1 

1 

- 

Totals 



~ i)(i - 2) 1 1 , 


Writing the proportional frequencies in the successive n intervals as /i , . . /^, as 
shown in the left-hand column, we construct column 2 by adding frequencies from the 
bottom. In the nth row we write in the (n — l)th row the sum +/n-i» bi the 
(n — 2)th row the sum -f/n-i H-/n~ 2 » so on, the first row containing the sum 

fn +/n-l + • ♦ ‘ /i- 

In column 3 the process is repeated wdth the rows of column 2, stopping at the second 
row, e.g. the nth row contains/^, the (n — l)th row (/^ +/„-i) + A = ^fn 
so on, the second row containing the sum (n ~ 1)/^ 4- (n —* 2)/^_j + . . . + 2/3 -f/*. 
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Column 4 repeats the process with the entries of column 3, but stopping at the third 
row ; and so on. 

Consider now the sum of the entries in column 2. In that sum /j appears once, 

n 

/j, twice, . . . w times. Hence the sum is equal to 


]' 1 




In column 3, /» appears once, /» 3 times, . . . /„ |w(w - 1) times. Hence 


? -1 


In general, the sum of the (/■ l)th column will be given by 


Sum - 


If the actual frequencies are used instead of the proportional frequencies the sums have to 
be divided by the total frequency N. 

Thus the process of summation gives the factorial moments directly. It is a modifi¬ 
cation of one which is due to C4. F. Hardy (cf. Elderton, 1938c/). The use of the method 
in practice lies in the fact that for certain calculating machines the progressive summation 
is easier to carry out than the processes involved in the method of Example 3.1. 


Example 3,7 

Consider again the data of Table 1.7, showing the distribution of 8585 men according 
to height in inches. The columns on the right in Table 3.3 overleaf show the successive 
sums. At the top of each column there has been placed within brai‘kets the number 
which would have been obtained if the summation were continued up the column one 
place further than is required for the sum at the foot. These bracketed figures are useiul 
to have as a check since each must equal the sum at the foot of the preceding column. 

From this table we find 

//(ij 11 020,850,320,33 

= 117055,096,097,84 

^ 1,194-957,483,983,69 

r.- 11,702-727,082,119,98 


From these values we may derive the ordinary moments, 
and find 


11-020,850,320,33 
^ 128-076,946,418,2 

p., ^ 1,557-143,622,597,5 

p\ ^ 19,702-878,509,027,3, 


using equations (3.19), 


from which we find, for the moments about the mean. 


= 6-616,805 

pi = - 0-207,840 
p^ = 137-689,186, 

the units being one inch. 
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TABLE 3.3 


Calculdfimi of the Factorial MomerkU of a Distribution of Men according to Height in Inches 

{Table 1,7). 


HeigJit. 

Frt^quoiioy. 

Fust Knin. 

Second Sum. * 

Third Sum. 

i 

Fourth Sum. 


2 

8,585 

1 

(94,014) 

i 

! 


58- 

4 

8,583 

80,029 , 

(502,459) 


59- 

J4 

8,579 

77,440 

410,430 

(1,709,785) 

00- 

41 

8,506 

08,807 ' 

338,984 

1,293,365 

01- 

83 

8,524 

00,302 

270,117 

964,371 

02- 

109 

8,441 

51,778 i 

209,815 

084,254 

03- 

394 

8,272 

43,337 

158,037 

474,439 

04- 

009 

7,878 

35,005 

114,700 1 

310,402 

65- 

990 

7,209 

27,187 ' 

79,035 

201,702 

06 

1223 

0,219 

19,978 

52,448 

122,007 

07- 

1.329 

4,990 

13,759 

32,470 

09,619 

08- ! 

1 1230 

3,007 

8,703 1 

18,711 

37,419 

09 

1 1003 

2,437 

5,090 

9,918 

18,438 

70- 

040 

1.374 

2,059 

4.852 

8,490 

71- 

392 

728 

1,285 

2,193 ' 

3,638 

12-^ 

202 

330 

557 

908 

1,445 

73 

79 

134 

221 

361 

537 

74- ' 

' 32 

55 ' 

87 

130 

180 

75- 

1 

23 

32 

43 

>0 

7a- 

\ 5 

7 

9 

] 1 

13 

77- 

2 

2 

2 

2 

2 

Totat.s 

i 

8685 

1 

94,614 

502,459 

1,709,7X5 

4,180,103 


Curmilanfs 


3.11. The moments are a set of parameters^ of a distribution which are useful for 
measuring its properties and, in certain circumstances, for specifying it. Their use in these 
connections will be considered in laier chapters. They are not, however, the only set of 
parameters for the purpose, or even the best set Another series of parameters, the so- 
called cumulants, have properties which are more useful from the theoretical standpoint. 

Formally, the cumulants kj, /Cg, . . - k, are defined by the identity in t 

exp . f -, + . . 

, = 1 + /'i< ^ + ... + .(3.22) 


It is sometimes more convenient to write the same equation with it for thus 


exp ^ k(»7) + +- • • • Xr-^ f . . .1 


1 ~{ /< 


(it) 
^ D 


t /.y+- • ■ 


= f e"-^dF 

J — x> 

^ 9(0 • 


. (3.23) 
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Thus, whereas n, is the coefficient ofin <p{t), the characteristic function.is the coefficient 
of in log if an expansion in power scries exists. 


3.12. If in equation (.3.23) the origin is changed from a to b, where as usual b - a — c, 

the effect on q>{t)is, to multiply it by for rfi'’ becomes dF. Hence the 

effect on log (p{i) is merely to add the term and consequently the coefficients in log <f{f) 
are unchanged, except the first, which is decreased by c. 

Hence the cnmulants are invariant under change^ of origin, exce])t the first. Jn this 
they vstand in sharp contrast to the moments about an arbitrary j^oint. 

Both eumulants and moments have another property of an invariai tivi^ kind, namely, 
that if the variate-values are multiplied by a constant cr, //^ and k, are multiplied by a\ 
This is at once evident from their definitions. Thus any linear transformation of the kind 

^ — lx \ n} . . . . . . (:b24) 

Ii'aves the eumulants unchanged so far as the constant m is conc(‘rned and multiplies 
by The sole exception is the first cumulant which is equal to the mean. In par- 
tifMilar if we transform a distribution to standard measure, the only effect is to multiply 
R, by <7 ', O' being the standard deviation and, as w(‘ shall see in a moment, being equal 
to 

The invariantive properties of th^^ eumulants was the origin of tlieir original name 
of semi-invariants, seminvariants or half-invariants (Thiele, 1889). It has, hovever, 
recently been shown that there are several other classes of parameters with the same 
propert \, and it seems V^est to restTve the word “ seminvariant for any ])arameter A,, which, 
under th(' transformation (3.24), is muiti])hed by The eumulants and the moments 
about the mean are thus particular cases of seminvariants. 


Relations hetwee7i Moments and Cumulant^ 

3.13. Subject to conditions of existence, we have, from (3.22) 

I + I • • • ^ /^r ■ 


J * , 1 

cxp|«,j, 1 i • 

■ ^ •‘'r< ■ ■ } 

(?0 (” 2 ') 

■ ■ ■ -I'■ ■ ■ 

(i 4 H ‘ 





Picking out the terms in the exponential expansions which, wdien multiplied together, 
give a power of f, we have 






PiW \Pay \PmW 


r\ 






. (3.25) 



62 


MOMENTS AND CUMULANTS 


where the second summation extends over all non-negative values of the n's such that 

Pt^i + . Pm^m == ^. 

It is worth noting that the rather tedious process of writing down the explicit relations 
for particular values of r may be shortened considerably. In fact, diflFerentiating (3.22) 
by Ky we have 

+ .. ■ 

and hence, identifying powers of 

- G)"'-'. 

In particular 

.(3.28) 

(jH- I 

and thus, given any in terms of the kb we can write down successively those of lower 
orders by a differentiation. 

The first ten of these expressions are, for moments about an arbitrary point:— 

Pi ~ 

P2 = ^2 + 

== '<■» + *^*<2*^1 + 

Pi = ><4 + ^k^k^ + -I- 6koK ?-4 kJ, 

pI = ^5 + 10k.^kI -h 15/c|/C| 4- lO/ca/c'J + /cj, 

Pii = #C0 + 6#f5/Cj >4“ 15^4^2 + 15 aC4k| 4' -4' 60iC3#C2#<i 4" 20k3#Cj 

4“ ISic^ 4” 45 k%2^j ")- 4~ 

^ fCy 4 4- 2 IK 5 /C .2 4" 4- 3r)/<'4#c3 4- 10r)K4fC2'^] 

4 - 35^4/^^ 4' 70/C3#cj 4 105^3^2 4“ 210#c3K2/ci 4- 35k'3/c} 

4 - ]05/<r^/C], 4 ~ 105/c2ArJ 4 - 21k.^k] 4 k\, 

P^ — K^ 4“ “4 28#C(^K-2 4' 28 /C,j#Cj 4" SG/C^Kj 

4 “ 35^4 '4“ 280 k 4 K’ 3 K 4 4 - 210 #C 4 #c| 4~ ^^Ok^k^k'i -j- 10 k^k\ 

4~ 280ko/C2 4~ 280k3K‘? 4“ S40k>>K2K^ 4' SGOacoico/c? 4^ 56«:o/c? 

+ 10r>4 + 4204kI 4- 2104k\ 4- 28/c2/<f 4- ^ ^ 9 ) 

p9 ==^ 94 - 4“ 36k-k:2 ‘S6k^kI 4 ~ 84k:p,k' 3 -f- 252 k:^jk:2/C| 

4 - 84KfjKi I' 120/0,^4 4- 504K^K;fKi 4 378^^2 4- 756/C5#C2^1 
4- 126/c5k:i 4- 3 I 5 K 4 /C 1 4- 1260/<:4;r3/c2 4- 12(>0fC4«:3«:‘f 4* 1890;^4/<‘2^j 
4- 1260 a:4/C2k:J + 126/<:4/<:J 4- 2S0k^^ 4- 2520k^K2Ki f 840/c^#<rf 
4- I 26 O/C 0 K 2 + 3780K3AC2/cf 4 “ 126()k»k2k} 4 S4KjKf 4 - 945/c2#C| 

4- 1260«:^M:i[ 4“ 378K;^Kf 4- SGk^k^ 4- 
Pio ^H) 4* IOicq/Cj 4“ 45KgK2 4“ 45k^k( 4 \2Gk-jK^^ 4~ ^GGk-jK^Ki 

4 - 12{)k’jk\ 4“ 2 IO/C 3 /C 4 4 840KrgK:3K4 4“ OSOfc^jfc'j 4- 1260 /C(jK2Ki 
4- 210/C(j#Ci 4 - 126Krf -}- 1260 k ^ 44 - 252 OK 5 K 3 K 2 4* 2520k^k^kI 
4“ 3780Kr,K2K4 4" 252OK5K2K4 4“ 252k^k\ + 1575KfK2 4“ 151 5kIkI 
4“ 2 IOOK 4 K 3 4- I 26 OOK 4 K 3 K 2 K 1 4" 4200k4K3k‘j + 315 OK 4 K 2 
4* 9450K4K2Kf 4" 315 OK 4 K 2 KI 4- 210k4Kj 4“ 28 OOK 3 KJ 
4- 6300k|k| f 12600 k|k2«:? 4“ 2100k|kJ + 1260()k3k|ki 
4* 12600K3KiK? 4 2526k.^k^kI 4- 120k3kJ 4 - 945k| + 4725K^Kf 
4" 315 OK 2 KJ 4“ 630k|kJ 4“ 45k2Ki 4 J 


J aK; ‘ ^ r! dKf ^ 
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or, for moments about the mean (k^ = 0), 


/^3 == IC 3 , 

^4 — K 4 + 3/c|, 

jUi = Kj + lOiesAT,, 

/Ut — Ke + 15#C4#C8 + IOkI + 15/c'^, 

/i? = /<r7 4“ Sl/cjiCj + 35k^K2 + lOS/CaicI, 

jUs = 4“ 28/c6K:a 4- 4- 35/c| 4- 210/C4/c| 4- 280#c|/f2 4- lOS/c^, 

//q = 4“ 36ac 7K’2 4" 84/C4/fa 4" 126ArfiK‘4 4~ SISk^k^ 4~ 1260/c4«:a#ca 4“ SSO/ciJ 

4- 1260/^8^2, 

i^io = #^10 4~ 4:6k2K2 + 120M:7/Ca 4- 210/Ca#C4 4- 630#C4#C2 4- I26/C5 
4- 2620k 2 4 - 1575>c‘^/c2 4- 2100K4Kr3 4- 3 150k 4^2 
4 6300/c|K:j 4~ 945K:j, 


Conversely we have 


Kj 

1! 


4- 





Expanding the logarithm and picking out powers of f as before, ve have 




r'y'V’C^:-V' //^e™Y"( ri.)'’’’(/>- 1)! 

44 ^W/ ' ' \pjJ 


(3.31) 


the second summation extending over all non-negative tt’s and p’s, subject to (3.20) and 
the further condition 


Til 4- Tt:* -b • . . ~ .(3.32) 


The first ten formulae are, in k^rms of moments about an arbitrary point :— 

= p -/'!/, 

/h - -V^l * 

<^4 = /4 — - 3^2^ 

«5 = ^ -t- 4- - 6()/42^'|-* 4- 24/4i'’, 

Kb = /iB - — 15/>4|02 4- 30/4/<|'^ — lO/t^'* 4- 120/43/4.i/Jj — 120 / 43 //]* 

t- 30/42** - 270 / 42 V;** 4- 360/4//;^ - 120/4,«, 

K, = /<^ - 7/<(;//] — 21/<5/<2 + 42//j/4]‘' 4" 210 / 44 / 42 //) 

- 210/4]/4;** 4 140/43Vi + 210 / 43 / 4 ;** - 12G0/4;/42/4;** 4 840/4>i' 

- 630/42Vi -f 2520/42Vi'’ “ 2520/42/4i-''‘ 4- 720/4i’, 

»<> = /<8 — G/zVi — 28/4'g/4; + 56/4;//!^ — 56 / 43 / 4 , + 336 / 45 / 4 . 2 / 4 , , 

- 336/45/4,** - 35/44** + 560/44/43/4, 4 420/44/42** - 2520/44/42/4i-* 

4- 1680/44/4',^ + SeOfi/ju's — lOSO/zaVi'’ — 6040/4;/4;Vi 

4 13440/43/42/4',** - 6720/43/4i* - 630/42* + 10080/4;*‘/4i^ 

- 25200/4;V'/ + 20160/42/4,® - 5040/4i®, 

44# /4g O/ 43 / 4 , 36/4,/42 4 *^2/4,/4j ^^/4c/4.t 4404/4 b/42/4, ^ ^ 

- 504/4^',® - 126/4'5/4'4 + 1008/4,;/4;/4'i 4; 756/4>2® - 4r>36/4;/42/4i** 

4~ ^ 024 / 45 / 4 ,* 4'' 630/4,^/4, 4" 2520/4j/ 43/42 ■ 7560/4,/43/4, 

- 11340/4;/42Vi + 30240/4;/4;/4,® — 15120/4,/4,® + 560/43’* ^ 

- 15120/43''Vi/4i 4- 20160/43 ''Vi'* - 756 O/ 43 / 4 ;** + 90720/43/42Vi** 

- 151200/4;/4;/4,'* +- 60480/43/41® 4 22680/4;Vi - 151200/42®/4;® 

4- 272160/42Vi^ - I81440/42'/4 'i^ + 40320/4i®, 


(3.33) 
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— 720-- 210/iij/4 4- 1680 /^«//J,/^i + 1260/y|5//2‘^ 

— + 5040///(.//j'^ — 126/4^ + 2520//^,//4^i 

-|- 5040///-/^!{/^2 ~ 15] 20/4//~ ^2r>80//'.//2'^//i ~f 60480/^5/^2/^^'^ 

- 30240//.,//;'^ -f 3150/4V'2 “ 9450/^;^? + 4200/4//:;-^ 

— 75600/.<j/^:{/^2/^i 4 100800/f4/!i//|‘^ — IBOOO//^///' 

-f 226800/4//2 "/^i^ — 378000/^4/2/// -j- 151200//i/// - - 10800/i;//4 

- 37800//.:V‘^^'^H--'^92400//:iV‘Vi‘^-^^>2000//VV/ 4 ' 3024(KW3//2'V/i 

- 1512000//;,^2Vi‘^ + 18i4400//4/2/// - 604800//:,/// 

+ 22680//2^ - 5C)7000//4/4‘'* 4- TZiSmOi)fi\^ - 3175200//2“//'/’ 
-I- 1814400//:2//4 - 362880//^^ 


or, for momentR about the ni(?an, 



— //2^ 





Ka 

=== //a, 






//4 

- 3/*i 





-- //f* 

-- IO//8//2, 





= //6 

— \r>iJL.fi^ 

-- i- 

30//:], 


f<7 

^ Pi 

- 21//5//2 

- 35//4/'4 

f 21()//3//5, 


Ks 

//8 

- iSiupi 

— ■■>G//5/(3 

- -f" 420^4j(t2 

560//m//2 — 030/4 

/<*9 

==- //» 

- 3G//,/(2 

84^ 3 - 

- I2G//4//4 ' 750/^//! 

+ 2r)20/(i//3//2 



+ - 

- 7 560//3//? 

5 5 


/<’l0 

==--= //lu 


120//7/i. 

j — 210//e//4 1' 1260// 

b/4 - i2(!//;r 



4- 5040//5//3//2 1 31ij 

4 4200/(4//,!-; - 

18000//,//2 


- 37800//:;//2 + 22680//;]. 


. (3.33) 


. (3.34) 


Existence of C^umulmit.s 

3,14. Tlie formal expression (3.22) may be regarcbal as defining the enninlants in 
terms of the moments, and it is thus evident that the cnmulant of order r exists if the 
moments of orders /■ and lower exist. If, however, wc‘ look to the equation 


exp 





as defining the cumulants, it is not (piite so easy to show that exists if //,. and lower 
//’s exist. It may, however, be shown that exists if r,, the absolute moment, exists, 
and this is sufificient for all ordinary purposes. Home eare is necessary with the proof 
because the variable t in the characteristic function is real, but there also ap}>ears the 
complex quantity i. 

We have 



(IF. 


Expanding the exponential we have, if the moments up to //,. exist, 



CALCULATION OF CUMULANTS 


(>5 


where 


== j* dF^os xt + i sin xt — 

Considering the real and imaginary terms separately, we have, if r is even— 

gir)+- - i(- 

w, (‘^ 0 " 


The real term in the integrand consists of (— 1 ) - plus cos xt minns the first ^ terms of 

) where 

it ~ «, 


the Maclaurin expansion of cos xt, and is thus equal to | 

\dx*i 

I xt K 

0 O'- 1 . The modulus of the term is tlius not greater than 2 -. Similarly for the 

imaginary terms. Hence 




xt ; 
r! 


dF 


3r 




A similar result follows if* r is odd. Now if ft' exists, it does not necessarily follow 
that v]. exists. But if the latter exists we have 




) 0 


We may then, for some small /. take logarithms and expand, obtaining 


log^{/) ^ mm/') .... (3..3r,) 

the coefficients Kj being the cumulants by definition. Hence if >7 exists, k, and cumulants 
of lower orders exist. 


CahuUxtio?i of C \imulav ts 

3.15. The cumulants are not, like the moments, determinable directly by suinmatory 
or integrative processes, and to find them it is necessary either to ascertain the moments 
and then apply equations ( 3 .. 3 . 3 ), or to derive them from the characteristic function. For 
the latter case we have, from (3.35) 

, , ^, = (-0''[/>J‘log^(02 .(3.30) 

The following examples will illustrate the processes involved. 
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Example 3.8 

Id Example 3.7 we found the following values for the moments about the mean of 
the height data of Table 1.7 :— 

yUi = 11*020,850 

Pi = 6*616,805 

Pi ^ — 0*207,840 
p^ ^ 137*689,185, 

whence, from (3.34) /c^ and have the same values as p^ and p^ and 

K 4 ^ p^ — 3 /< 2 ^ 

= 6*342,86. 

t<i is the same as p^, in this case measured from the centre of the interval 56- inches. 
The same results would, of course, have been obtained if we had used equations (3.33) 
and moments about the origin. 


Example 3.9 

Consider the discontinuous distribution whoso frequencies at the values 0, 1, . . . j . . . 
ai-e jV • * • j • • • characteristic function is given by 




y-0 


= e exp 
— exp m(c*^ — 1), 

Since for any r the absolute moment is the same as the ordinary" moment, we have 




or 





and since this converges * cumulants of all orders exist, 
the expansion of log as a power series in t. But 


They are therefv j given by 


log = m(e^^ — 1) 


= m 


7 ^ 


and hence = m 

for all r. Thus all cumulants of the distribution are equal to m. 


^ For the ratio of the (n 4* l)th term of tho series to the nth is 
Mn 4 1)’' /tn”n^ 


(n + D! / n! +1^) “ ®(^)' 

and thus the aeries converges for all Bnite values of m. 


iy« 
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Emmple 3 JO 

In Example 3.4 we found, in effect, for the characteristic function of the normal 
distribution 


dF 


1 

oV(27r) 


e ‘iff* r/.r 


1 

‘f>{0 = -77^J >Ijc 

^*ff» 

c~ 2 


log <!>(() == 




It is easily seen that the absolute moments and hence cumulants of all orders exist. Thus 
{itY 

Kj. is the coefficient of in log <^(^), i.e. for the normal distribution all cumulants of order 
higher than the second are zero. The second eumulant is ociual to 


Example 3J1 

In Example 3.6 it was found that for the distribution 

r(y) ^ ^ CO 

the characteristic function is jriven by 

It is readily verified that cumulants of all orders exist and hence 

= coeff. of in — y log 

™ y{r 1 )! a''\ 


Example 3.12 

Consider again the distribution of Example 3.3. 

k 

dF — - dx w > J. - 00 .r < c». 

(l+:i‘2)m 

The characteristic function is given by 

Tor gO'/ 

which, since sin xt is an odd function, reduces to 



cos xt 

(i + x^r 


dx. 


This integral may be evaluated by complex integration round a contour consisting of the 
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x-axis, the infinite semicircle above the a:-axis and the infinitely small circle round the 
point X = i. It is found * 


_ 1)!"'" I ' i I * I 

^ (m + ])(w)(m -- l)(w — 2) | | )»,-.t | 

If r <; 2m — 1 the absolute moment of order r 


(2w - 2)!'l 
(m ~ 1)! J ■ 


’V 



I X I** dx 

(1 


existH and hence so does the cumulant of order /•. But in this case we cannot expand 
log in an infinite series of powers of t, though this might perhaps be thought possible 
from the form of In fact, we can only expand log in })owers of t up to the point 

at which the differential coefficients of fi{t) exist, for t ~ 0. 

To simplify the discussion, consider the ease when m 2. We have then, since 
k = 2/7T in this case, 

</>{/) - ^'-'''{|/| + u 

log -= - I / I + log {1 f- j / I} 

If i is positive this equals 

2 ' 3 ~ * * 


but if i is negative it equals 


f2 p 
2 ' 


the two expressions differing in the sign of the term in and every second tfum thereafter. 
There is tluis no unique expansion of log <f>{t) in powers of t about the point t — 0. There 
are two forms of the function expressing log 4^{t) according as t is positive or negative. 

How^ever, these expressions coincide as far as their terms in t and and the first 
and second differential coefficients of log 4>{t) are uniquely defined when / — 0. Thus 
the first and second curnulants exist and are given b^' 

Ki ~ 0 

K-J - 1 . 

Cuinulants of liigher orders do not exist. 


(Jorrectiont^ for Grouping 

3.16. When moments are calculated from a numerically specified distribution which 
is grouped, there is present a certain amount of approximation owing to the fact that 


* liesults of this kind aif given in siweral text-hookb of analysis, sometimes incorrectly, e.g. it 
is sometimes stated that 


f 


^ cos tx 
1 + a* 


, -/ 


which is only true when / ^ v 0- The appearance of the modukis in the expression above is crucial 
for the purposes of the example. A correct proof is given in J. Edwards, Integral Calculus, vol, 2, 
article 1326. 



CORRECTIONS FOR GROUPING GO 

the frequencies are assumed to be concentrated at the mid-points of intervale. It is possible 
to correct for this effect under certain conditions. 

Suppose the frequency function f{x) to be continuous. If the range is divided into 
intervals of width h, we are given, not the values of f(x) at all points but the frequencies 
in those intervals, e.g. the frequency in the jth interval, centred at will be 

h 


We will denotes the moments calculated from grouped frequencies—the ‘‘ raw ” 
moments—with a bar, so that we have 

j ^ 

“ X" .(3.37) 

The true moment, if it exists, is given by 



and it is rcnpiired to investigate the relationship bctweeii the /Z’s and the //'s. 

Now we have, in virtue of the Euler-Maclaurin sum formula, for an arbitrary function 
k{x) whi(‘h lias derivatives of the rath order, 


1 ‘ ft/i 

fi, 


V -- {|/c(e/) I K(a -j- Ji) I- K{a r -/<) r 


2 ,, [«-' "(ol 


K{a ^ a - 1/,) 




lK(a vh)} 
. (3.38) 


where S,^^ is a remainder term which may be expressed as 

nh 




0 ' 0 -. I 


ni even, 

/iWt 

and ,V„, == 0 - 0 i 

wl 

VI odd.* 

Suppose now that is of finite range, from a to />, derivable up to the /ath order, 


* Of. Milne Tliornson, The Cahulus of Finite Differences, eociion 7.5, for the general Exiler-Maclaurin 
expansion. The form of S,,, when m is even is given in section 7.5 of that, hook, and the above form 
when m, is odd may bo derived similarly. 

In our convention the Bemouilli number is defined as the coHffioient of in t/{e^ — 1). Iho 
Bernouilli polynomial has already been defined in 3.9. Kxplicitly 7?^ = 1, - J, — J. /?3 "= 1^6 


- ^ 0 , 




1 

30’ 


B, 


dii’ 


091 

2730 




7 

'6* 
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and that at the end of the range f{x) and its first m derivatives vanish. Then f(x) and 
the first m derivatives, are continuous throughout the range ^ co to -\- <X) and the function 

h 

k(jc) -= ^ f{x i) . . . . . (3.39) 

~"2 

together with its first m -f 1 derivatives, will also be continuous throughout that range. 
If a is infinite (and similarly for b) it is assumed that 

lim ^ 0 

J —->► X, 

for all values of j up to and including m, in which case k(x) and its first m + 1 derivatives 
will also tend to zero. Thus in either case the Eulcr-Maclaurin expansion (3.38) is valid 
for k{x) given by (3.39) and we msiy write 

J _ 0 j ' m I 1. 

Substituting in (3.38) we liave. since k{ - oo) _ k(-\- oo) 0, 






- »S\, 


I 


"■ f-^7 ^ (H I ! 

The integral on the left of this expression is ecjual to 


(3.40) 


(3.41) 


provided that the multiple integral exists. If, in addition, it is absolutely convergent we 
may substitute x for x h S «nd integrate with respect to We shall then have 


S 


/n 4 t 




(.*• - f)7(j) (/* {/x 






- V 


where is i'ii® integral part of 


(3.42) 
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Thus if may be neglected, (3.42) gives the raw moments in terms of the actual 
moments. In practice we require the latter in terms of the former and it is easy to find 
from (3.42) the following expressions :— 


/“’i = P-'i 

f *'‘2 = P ‘2 ~ 

fAi = P's ~ 



II 

J'. 

! 

2^2*^ + 

240 



T) ,, 

7 , 






^ Pc* ~ 

'^Pil>^ I 



. (3.43) 


The general expression for these formulae is 

wliere B, is the Bernouilli nuTn})er order (CT Wold, ) 


(3.44) 


3.17. 4’hese are tlie eoireetions known as Sheppard's. T1 is important to realise 
t})e (‘onditioiis under which they were obtained. 

(u) ft is assum(‘d that/(O is bounded and tends monotonically to zero in the directions 
in which the range is infinite 

(6) Tt is assumed that the multiple integral (3 fl) is absolutely convergent. This is 
equivalent to supposing that the absolute moment of order ? t'xists. If /(.^•) is finite in 
range a 4 :\d bounded, the multiple integral is certainly absolutely convergent. If the range 
is not finite, since f{x) tends to zero monotonically in the direction oi directions of infinite 
range, 

h 

will (‘onverge or diverge with 

h 

'Sj\ 

i.e. with J I X* | /(.r) dx 

which is the absolute moment of order r. 

(c) It is assumed that f(x) and its first m derivatives vanish at the terminal points of 
the range when the range is finite, or that 

lim —>• 0 

for all j up to and including r when the range is infinite. 

(<:?) It is assumed that >^^+1 is negligible. 
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Now both 


and are less than 7 ^; in magnitude * and hence is of order 




( 2 ;)! 


m 


62 / 


multiplied by some value of in the range. Thus if h is small, the range is 

finite and p^\x) is small; ^ will be small and may be neglected. In particular, if 

< w.(3.45) 


the Sheppard corrections will give the moments accurate to order i.e. to the order 
of the terms applied in making the corrections. 


3.18. The foregoing discussion is rigorous, but the corrections may be applied in 
practice with considerable confidence whenever there is high-order terminal contact. 


Example S.13 

Consider the distribution 

dF = - x)^dx (» < x 1, 

a case of the so-called Type 1 distribution. The exact frequencies for intervals of 01 
may be obtained from the Tables of the Incomplete J5-Function, and are as follows : — 


Centre of Interval. 
006 
016 
0-26 
0-36 
0-46 
0'66 
0-66 
0-76 
0-86 
0-96 


KreqiiojK‘> . 
0000 , 000,0 
0,000,009,2 
0 000,040,8 
0 009,938,2 
0 001,137,4 
0 192,199,0 
0 332,887,7 
0 297,479,9 
0 101,033,7 
0 004,(567,5 


Totai. 


1 000,000,0 


The raw moments about .r — 0 are shown in the following table : -- 


Moment. , 

1 

Raw. 

Kxact. ! 

Corrected. 

, 1 

0-660,602,8 ' 

0’66(>,606,7 

0 066,662,8 

Mi 

<»-45(),966,5 

0-456,140,4 

' 0466,132,2 

m', 

()-320,952,3 i 

0-319,298,2 

()-319,285,7 

Mi 

0230,335,1 

0-228,070,2 

0-228,063,2 

m; ' 

0-108,512,9 

1 0-165,869,2 

0-166,848,0 

Mi 

0 126,433,2 

j 0-122,.599,0 

0-122,574,0 


^For Bo, 

(cf. Milne Thomson, loc. cit,) 
and further 


> 0 and 


2j\ 
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The exact values of the momenta are calculable by evaluating integrals of the type 
j* x)'* dx and are shown in the third column. The final column shows the 

results obtained by applying equations (3.43), e.g. 

Pz == 

0-450,905,5 - 0 000,833,3 
0-456,132,2. 

At the terminal x ^ f{x) and its derivatives up to the fourth vanish. At the other end, 
derivatives up to the tenth vanish. The function is bounded, of finite range, and the 
derivatives remain finite throughout the range. In virtue of (3.45) it is to be expected that 
corrected moments of third and lower orders will be accurate to the order of the terms 
in the corrections, i.e. /^2 accurate to order (0*001) and to order ^0 0003). Actually 
they are considerably more accurate than this. The corrected fourth moment is in error 
by a term of order 2 x lO ’h and this is of the same magnitude as llie correcting term 
j hi arriving at it. ►Similar]y the corrected fifth moments are in error by a term 

of order 10“"-'*, of the same order as one of the correcting terms to the fifth moment, 
7 , 

and of the same order as or greater order than two correcting terms to the sixth 
48 

7 31 

moment, and - t-— , 

16 ^ 1344 

'rims the corrected moments are in all cases a substantial improvement on the raw 
moments ; but in a])plying th(‘ corrections it is necessary to guard against being misled 
about the accuracy of the final n^snlt by the apparent precision of sonx' of the small 
corr<‘ctive terms. 


Examplv oJ4 


As an illustration of the way in whicli fShexipard’s corrections 

break down when the 

(condition for high-order contact is violat(‘d, an example is taken from a ]mper by Pairman 

and Jk\arson (11)18). The following tabic shows tlie fioquoneies in 

a certain range of the 

normal distribution 


1 r'* 

r/F - - , c -* dx 


\ 2.1 


with intervals ot width 0-5. 


Interval centred at 

Frequency. 

15 . . 

04>55,91 

2-0 . . . ■ • 

0-278,34 

2-5 .. . . 

0-092,45 

30 . 

0 024,02 

3*5 . . .... 

0004,89 

40 . . ...... 

. 0 000,78 

4*5 .. . . • 

0 000,10 

. .. 

0 000,01 

Totau 

1 056,50 


The distribution has high-order contact at one end but not at the start of the curve, 
being in fact J-shajied and very abrupt at that point. 

The following table shows the raw moments about the mean up to the fourth order, 
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the moments with Sheppard’s corrections and the true moments calculated fix>m the 
continuous normal distribution :— 


Moment. 

Raw. 

Exact. 

Corrected. 

iW2 

I 0-158,524 

0-172,222 

0-137,091 


1 0-104,226 

0-098,612 

0-104,226 

i 

0-149,090 

[ 0-166,405 

i 0-131,097 

i 

i 


It will be noted that in the two cases where the corrections are made they operate in the 
wrong direction. For the fourth moment they increase the diffei‘encc between calculated 
and true values from about 4 per cent, to about 16 per cent. It is clear that, at least for 
the fairly coarse grouping of this example, Sheppard’s corrections may fail completely. 

3.19, Equations (3.43) were written in terms of moments about an arbitrary point. 
This point can, in particular, be the mean of the distribiition, and accordingly we may 
drop the dashes and put erpial to zero in (3 43), to get the corrections appropriate for 
moments about the mean. 

3.20. The discussion of the Slieppard corrections up to this point, and Examples 
3.13 and 3.14, have supposed that the given frequencies were those of a distribution 
which was exactly specified by a continuous mathematical function. In i^ractice this 
case very rarely occurs, the most common necessity for grouping c*on*ections arising when 
moments are calculated from tables such as those of Chapter I. For such tables it is 
not possible to state categorically that the corrections will result in an improvement ; 
but there are usually strong presumptions to that elFect. Consider, for example, the 
height data of Table 1.7 (Example 3.7). There can be no doubt that the histogram provided 
by this material can be graduated by a smooth curve and that such a curve will give better 
values of the moments than the histogram. Moreover, the tailing-off at the (extremes of 
the distribution supports the assumption that the conditions for terminal contact are 
satisfied. It may therefore be confidently assumed that Sheppard’s corrections as applied 
to the grou})ed data will give improved values for the exact values of the moments which 
would have been derived from the ungrouped data had they been available. 


Average Corrections 

3.21. There is a distinct type of problem which also leads to the Sheppard corrections. 
Suppose there is given a distribution of unknown range and the freqxiencies falling into 
specified intervals, one may ask what are the corrections to be apy)lied to the raw moments 
so as to bring them on the average into closer relation with the real moments. In other 
words, supposing that the interval-mesh is located at random on the distribution, what 
are the average values of the raw moments ? 

Let be a fixed set of values of r, g varying from — ao to oo by integral values. As 
X: varies from X /» to X,Jt, Xu varies from X, n to X, . 

By definition 




AVERAGE CORRECTIONS 

Denoting by Eijl^) the average as Xf varies from X u to X *, we have 


’^hE] „^/'J , M + 

' ' 'J Z 2 
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(nAi}) 


which is the same as equation (;h4()) with the omission of and the substitution of 

E{fL^) for /I^. Thus the Shepjiard corrections apply fo^ the average group-moments 
whatever the nature of the terminal contact. 

They cannot, however, be applied indiscriminately on ^bat ground. In place of the 
conditions about terminal contact, which ensine the applicability of Slieppard’s corrections 
lo any particular distribution, there is the condition that the grouping intervals are located 
at random on the range, which implies that although the eorrections may be wrong in any 
given instance, the average effect in a large number of cases will be (‘orroet. In actual 
fact the condition about tlie random location of grouping does not operab' very frequently 
for J- and I^^-shaped distributions, v here the Sheppard corrections would not ordinarily 
apply ; for instance', in a distribution of incomes or deaths at given ages it is almost inevitable 
to begin the groiqiing at zero. 


3.22. It is also illegitimate to drop Ihe dashes in order to obtain corrections for 
moments about the mean. If the mean of the grouped distribution is denoted by y, the 
average value of the rth moment about the mean is given by 

h 

m,) - (/)'/(a- ^ 

whore y is a function of jr and the transformation of the integral which has been used earlier 
in this chapter is no longer legitimt*te. Explicit expressions for average corrections to 
moments about the mean have not yet been obtained. From a consideration of some 
particular distributions, however, Kendall (1938) concliidc^d that for all ordinary purposes 
it is sujfficient to use equations (3.43) as if the mean were a fixed point. 


3,23. The Sheppard corrections have also been considered from a slightly different 
point of view (Fisher, 1922). As the centres of the intervals move along the variate axis, 
the raw moments vary according to the different groupings wliich i*esult ; and this variation 
is evidently periodic of period h. We may thus write 



f{x) dx. 
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where 

and may put this equal to 


O' ^ i> 


Ao f f Jasin204 . . . 

4 Bj cos 6 B 2 cos 2(9 4 . . . 

Then, multiplying by sin .s*0 or cos s'O and integrating from 0 to 2n, we have 


A s — ^ I «in dO 1 ^ f dx 

J 00 C ,£ 

rx'^ 


and in particular 




27T 

Since dO — ^ di^. we have 


1 ^7 fo' D* r*’''2 

h 


which is the same as (3.41) and (3.46), and thus leads to the Sheppard corrections. 
For the periodic terms we have 




. 27r.sS 

Sin —dl I 
h 


r ^2 

, dx 

|| Rx) dx^ C sin rfc 


For some mathematically specified distributions we are able to consider the magnitude 
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of these periodic terms. For instance, for the normal curve referred to the true mean 
we have, since 



C sin 



h 2718X 

- - cos — cos 718 
718 h 



—; - C 2 o« dx 

a \' 271 


(- 


7. 


7TS 


ifis - 

where and refer to the coefficients for the corrections to the 'uean. I’he grouping 
error of the mean is thus 


/z / _ 2^*77* Hn'jT* 

“Ve sin d - le sin 20 A- • 

7T 


. etc-). 


For a grouping in wliich a = h (a very coarse grouping) this is, approximately, ^ a sin 0 


and thus cannot be greater than - t 

71 


3.24. Average corrections may also be applied to discrete data wiiieh have been 
grouped in wider intervals but are different from those of the contimious case. Cf. Exercise 
3.13 and V. (\ Craig (1936). 


Bheppard's (Jorreefions to Factorial Momenta 

3.25. It has been shown by Wold (1934<7) that for factorial moments the Sheppard 
corrections are as follows :— 


/Ml ^ 



fr¬ 

/M 2 ) M 2 ] - 

iz 

, tr 

//[.jj ---- /Xfs] 

+ 4 

/^14j A[4I ■' 

2 ^ f’-f'' g(/'' 

“ M.j 1 

.5_. , 6 _, ,3 71_. 


5 j „ _ ,3 213 

i 5/ir3j«=’ 


31 


//•' 


, 9129., 


. (a.4-) 


§GK-'( 


and in general are given by 


— 




(3.48) 
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where the Bemouilli polynomial is equal to 


and 


(- 1 ) 


J-H 


(2i)! 
2‘^’(j + 1 )! 

mi 




+ 


f 


2j - 


i)- 


1 , mi) == 0 . 


j> 1 


Sheppard’^ Corrections for Cvnmlants 

3.26. Ab in section 3.16, and under the same conditions, we have, writing 0 for it, 

h 


1: f-f.A. 


S) dS 


ft 

Ifi 

2 

sinh 

Oh 


J —ao 

r e^\f{^r)doc, 

J — no 


e d^ 
Oh 


dx 


(8.49) 


The expression on the left gives the characteristic function for the grouped data, and the 
integral on the right the true characteristic function. Taking logarithms of both sides 
and noting * that 





0^ 

we have, for the coefficient in ^ 





(8.50) 


an attractively simple result for the Sheppard corrections to cumulants. Since all 
of odd order are zero except and the first cumulant is equal to the moan, no cuinulant 
of odd order needs any connection. For the others we have 





/C2 

=- Ki 

12 



h* 

^4 


-f - 

120 




*<B 

— ^0 

M2 


* By definition 


and hence 


c® — 1 rl 

r «0 

^ I 6 2 rl 

yr 2 


integrating from 0 to 6 wo have the above rosult. 
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Grouping Corrections when the Distribution is Abrupt 

3«27* Various writers have considered the corrections to be applied when one or 
both termitials of the distribution do not obey the Sheppard conditions for terminal contact. 
References are given at the end of this chapter. 

Multivariate Moments and Cumulants 

3.28. The foregoing results in this chapter may be readily gtmeralised to the multi¬ 
variate case. To save complicating the algebraic expressions, we shall deal with 
two variates Xi and ; but the reader will have little difficulty in carrying out any 
generalisations for more variates. 

The bivariate moment about an origin for .r, and for ^ is defined by 

— f { (^1 " a,)^dF .... (3 52) 

J Xj J oo 

Jf one of r, s is zero the* moment becomes the ordinary univariate moment of the row or 
column-border distribution of the bivariate population. In ^he contrary case we meet 
H new tyx^e of moment—the produetz-moment. The first x)roduet-moment //, ^ is of particular 
importance in the theory of correlation. The first product-moment about the variate 
means, //j,, is known as the ( ovariance. 

As in the univariate case, bivariate moments about certain points can be exi)ressed 
in terms of those about other jKhiits. If the Xi origin is ti-ansferred fiom a, to 6j where 
r, == 6, - Oi, and the origin from to b^, v here Cg ^ b.j. a 2 , we have 

= if*' + -i- C’tT .... (3.53) 

where thie product on the right is to bo replaced by //^*(6i 6*). This corresponds to 

the svmbolic equation 

//(a) = + rr 

for the univariate case. 

Methods of calculating the product-moments for numerically s])ecified distributions 
will be considered in Chapter 14. The determination of bivariate moments for a niatlio- 
matically specified population is a matter of evaluating double sums or double integrals, 
and no new statistical points call for <‘ommeiit. 


Example 3J6 

The bivariate distribution 


dF = — exp 

Let us evaluate :— 


oil] 


1 (x\ 

2(1 p^)Vcr? 

M(h, «,) = ( f e'-'- +•'■' (IF. 
J ~P0 J —TO 


CO ■; .Ti, Xi * 00. 


Making the substitution, 


f =. Xx — a\tx — 
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we find 

= exp{|{<?trf + -f- X 

1 r r . j _ 1 

2jr€ri{Ta(l —/>^)U 2(1 — ^®)\crf 


(7,(72 



= t'Xp{J(<‘f<7f i 2p(7,(7j/i/a I 

fr ff 

Now is the coefficient of J in M{f^, t^) and thus we find, for instance, 

/'/20 ^ “ P ^ l ^ 2 y /^02 “ 

/^ao =- /^21 = = /^03 = <> 

/^40 “ ScTj, //31 3p<7jO'2, /^22 (i ~i~ 2p^)f7|(7.j, 

/^13 “ •^/5<7i0‘2, /^o<i “ '^0'2* 


3.29. The bivariate analogue of equation (3.22) may be written 


expl-"*' f 1 

^^\l!0! ^ Oil! 

• • + • 

■} 




__ 1 1 

^ 1!0! 

, /'(n /2 , , ."'r.-.., 

* 0!l! ^ • • • ’■ 

<1 i-. . . . 

. (3.54) 

or symbolically, 

"'-h‘ 

«(^ + /z)"! - 1 

ur • 

. (3.56) 


where 


v(/. 4 M ^ • 

In terms of characteristic functions wo may define 

prx- poo 

J ~~ao J — ir 


and, as before, write 


■ ■/ 


(3.5fi) 


. (3.57) 


t^) = y 

r, H- (> 


/^rs 


rf '.s! 


exp 


00 


{ifiY {iuy 


rl 


si 


, (3,ryH) 


subject to conditions of existence. 

From these equations the bivariate moments can be expressed in terms of bivariate 
cumulants and vice-versa. It is also possible to derive bivariate equations from the univariate 
equations by symbolic processes (cf. Kendall, 1941). 


3.30. Wold (19346) has given the following expressions for Sheppard corrections to 
bivariate moments and cumulants, the variates being grouped in intervals hi, h^. 


Mr 






. (3.69) 




MEASURES OP SKEWNESS 
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In paxtioular 

M 2 O ^ A 20 = P'119 /^02 = P 02 — ~i\^2 

. . M . M 

/^30 = Mao — two symmetrical equations 


- A? 

M40 = M4U ““ M207> 

7 . . , , /r 

94 (/^n M .11 === Pm “ ^ 114 * symmetrical equations 

. . (3.60) 

hi 

M 22 === M 22 “* M 2 ()j“^ “ 

M , MM 

- /"02j2 + j|- 



For cumulants 

we have 





> 0 '1 



BJi\ 

^rO - 

r 

1 

r 2 

1 * * * 

(3.61) 


BJfl 

1 

.s‘ 2 1 

0 



yl/rr/s^/ZY s 0/ 

3.31. We have considered measures of location and dispersion in Chapter 2 . With 


tlu‘ aid of the moments we can now proceed to consider measures of other qualities of the 
population, and in particular its departure from symmetry. 

In a symmetrical population, mean, median and mode coincide. li is thus natural 
lo take the deviation mean to mode or mean to median as measuring the skewness of the 
distribiition. K. Pearson proposed the measure 

Mean - mode 

a 


wliich is subject to the inconvenience of determining the mode. For 
quenc^'-distributions known as Pearson’s (cf. Chapter 6 ), this measure 
exx^ressed exactl}^ in terms of the first four moments. We define 

a wide class of fre- 
may, however, be 

■ • ■ 

(3.02) 

a. -• • ■ 

Then it may be shown that for Pearson curves 

. (3.63) 

q/. VPliP'l 4 ‘ 1 ) 

2(5^, - ^pi - D) 

. (3.64) 


and this equation may be taken as defining a measure of skewness applicable to all 
distributions whose moments up to and including the fourth exist. 

The coefficient pi itself is also a measure of skewness. Clearly if the distribution is 
symmetrical it vanishes since vanishes, and the size of relative to fj.\ (or \/pi) will 
indicate the extent of the departure from symmetry. 

A.S. 


G 
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Generally we may define 


j^8/^ 2n+3 

,.nV8 

^2n4-a 

i“2 


. (3.66) 


quantities which are not in general use but will be found to occur occasionally in statistical 
literature. 

More convenient quantities than and for certain purposes are 

/^a ^3 


ri 


fil k:^ 


. (3.06) 


.(3.67) 

/^2 Kg 

If the distribution is expressed in standard measure, and are its third and fourth 
cumulants. 


Kurtosis 

3.32. In the so-called “ normal ” distribution 

1 _ 1 jL* 

(iF == - ~ -e 2 doc, — 00 < X < 00 

oV 271 

attains the value 3 and y^ is zero. Curves for which y.^ = 0 are ' ^Ued Mcsokurtic. 
Those for which y* > 0 are called Leptokurtic and will, re^lative to tl curve, be 

sharply peaked. Those for which y* < 0 are called Platykurtic and w' . . ped. 

Example 3,16 

For the distribution of Australian marriages considered in Example 3.1 we found, 
for the raw moments about the mean in units of three years, 

7 056,977, /Za = 36151,595, = 408-738,210. 

With Sheppard’s corrections these become 

= 6-973,644, =- 36 151,595, = 405-238,888. 

From these values we find 

/?! == 3-854, y, 1-963 
^ 8-333, ya == 5-333 

indicating considerable skewness and leptokurtosis. 


Example 3.17 

From the formulae for the moments of the binomial distribution considered in Example 
3.2 we find 


71 = 

ya ===. 


<l -V 
\^npq 

1 — 6pg 

npq 


so that, as n —^ oo, yi and ya 0. This is in accordance with a result we shall prove later, 
that the binomial tends to the normal form as n tends to infinity. 
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Moments as Characteristics of a Distribution 

3.33. The use of moments and cumulants in determining the nature of a frequency- 
distribution will be abundantly illustrated in later chapters, but some genc^ral remarks may 
be made at this stage. 

It has been noted that the characteristic function determines the moments when 
they exist, and it will be proved in Chapter 4 that the characteristic function also deter¬ 
mines the distribution function. It does not, however, follow that the moments completely 
determine the distribution, even when moments of aU orders exist. Only under certain 
conditions will a set of moments determine a distribution unique^, but, fortunately for 
statisticians, those conditions are obeyed by all the distributions arising in statistical practice. 
For all ordinary purposes, therefore, a knowledge of the moments, when they all exist, is 
equivalent to a knowledge of the distribution function . equivalent, tha^ is. in the sense that 
it should be possible ihemetically to exhibit all the properties of the distribution in terms 
of the moments. 


3.34. In particular we expect that if two distributions have a certain number of 
moments in common they will bear some resemblance to each other. If, say, moments 
up to those of order n are identical we know that as n tends to infinity the distributions 
approach identity, and consequently we expect that by identifying the lower moments 
of two distributions we bring them lo approximate equality. Some mathematical support 
for this so-called Principle of Moments may be derived from the following approach ; 

It is known that a function which is continuous in a finite range a \o b can be repre- 


OC) 

sented in that range' by a uniformly convergent series of polynomials in u*, say z Pn<^) 


n 0 


where is of degree n. Suppose we wish to ri'prtwnt such a function approximately 


by the finite series of powers y a The coefficients may be determined by the 

« — 

principle of least squares, i.e. so as to make 

(/ — (fx ..... (3.68) 


r 


a minimum. 


or 


Differentiating by we have 



(lx ~ 0 

= f r?.r. 

J (I 


(3.69) 


If now' two distributions have moments up to order n equal they must have the same 
least-squares approximation, for the coefficients are determined by the moments in 
virtue of (3.69). Furthermore, if in the range the distribution /i dihers from by 

€i and /a by then /i differs from /a by not more than -| 

A similar line of approach may be adopted when the range is infinite, the distributions 
in such cases being, under certain general conditions, capable of representation by a series 
of terms such as e“‘^*jP^(a?), (Cf. Chapter 6.) The same conclusion is reached. 

Thus distributions which have a finite number of the lower moments in common will, 
in a sense, be approximations one to another. We shall encounter many cases where, 
although we cannot determine a distribution function explicitly, we may ascertain its 
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moments at least up to some order ; and hence we shall be able to approximate tjo the 
distribution by finding another distribution of knowai form wjiich has the same lower 
moments. In practice, approximations of this kind often turn out to be remarkably good, 
even when only the first three or four moments are equated. 

Mean Values 

3,35. To conclude this chapter we may note that the moments are particular cases 
of a general class of functions known as Mean Values. If we have a function ip{x) defined 
in the range of a distribution, then 

y}{x) (IF, .(3.70) 

if it exists, is called the mean value of y){x) for that distribution ; it is sometimes written 
as a notation we shall often find useful. The moment of order r is thus the mean 

value of x^' and the characteristic function is the mean value of The letter E in this 
connection is the first of the word expectation,” and mean values as we have defined 
them are sometimes known as “ expected ” values, particularly in the theory of probability. 
The objection to this practice is that only rarely is it to be expected that we shall meet with 
the “ expected ” value in sampling. 


3.36. Two important propt^rties of mean values are to be noted. In the first place, 
if we have two functions 'ipxix) and 


J dip J (IF ^ J I 

and thus 

-f + ./^(v^g), .... (3.71) 

i.e. the mean value of a sum is the sum of the mean values. 

Secondly, if we have two inde<pendeni variates x^ and .Tj distributed with functions 
Jpg ; and if is a function of .r^ and yy^ of then 


or, 


IJ 


7 - 1^2 (IF I dF i 



= E(y)r)E(y)i) 


. (3.72) 


so that the mean value of the product is the product of the mean values. This is in general 
only true if the variates are independent, whereas (3.71) is subject to no such restriction. 


NOTES AND REFERENCES 

In most of the literature what have here been called ‘‘ cumxilants ” are referred to as 
semi-invariants or seminvariants. They were introduced by Thiele (1889), who, however, 
failed to draw a clear distinction between the parameters of a population and estimates 
of those parameters from a samx>le, with the result that for some years there was a confusion 
between semi-invariant parameters and semi-invariant statistics. (This is in no way to 
be interpreted as a criticism of Thiele, who could hardly have been expected to write fifty 
years ahead of his time.) Some recent work by Dressel (1940) has shown the desirability 
of reserving the name ‘‘ seminvariant ” for the more general class of parameters which 
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axe, except for powers of acj, invariant under transformations of the origin. Dreasel points 
out the analogy between such parameters and the functions of the coefficients of the binary 
form 

“o*" I- + . . . I- + . . .a,,y”, 

which are invariant under transformations of type 

^ = /:r -I m, y = ?/. 

The word “ seminvariant ” has been in use for many years in the theory of algebraic 
invariants to denote such functions. The word “ cumulantis due to Fisiier and Wishart. 

A comprehensive account of the mathematical relations betweeii moments, factorial 
moments and cumulants is given by Frisch (1926). 

']'*here is an extensive literature on corrections for grouping. Kendall (1938) gave 
a bibliography which appears to be comidete except for the omission of a paper by Fisher 
(1922) and one by Elderton (19386). For corrections io the case when the Sheppard 
conditions are violated, see Pairman and Pearson (1918) feandon (1924), Martin (1934), 
Pearse (1928) and Elderton (1938a). For Sheppard’s corrections for j discrete variable 
(which appear to be due to H. C. Carver) sec Craig (P336) , and for the corrections in the 
multivariate case see Wold (19346). 

References to the problem of moments (i.e. the conditions under which a set of constants 
can form the moments of a distribution) are given at the end of Chapter 4. As to the 
mathematical basis of the principle of moments, see Merzrath (1933) and Romanovsky (1930). 
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EXERCISES 

3.1. Show that the rth moment about the origin of the distribution 
dF kx dx 0 .r " oo, >'">0 

_ y’ ^ — 1) 

~ r(P - 1 ) 


if r < p - 1, and does not exist in the contrary case. 

3.2. In the distribution 


(IF - l(\ + 
show that, about the origin, 

(‘OS -2 (j 0 fj[Q 


— CO ^ X ^ 00 


and hence that 


a 

2m — r 


{(r - l)a/(; ^ 


3.3. Show that the discontinuous distribution whose frequencies corresponding to 
the values 0, 1, . . . . are 


( ’ 1!’ ■ ■ ■ j! ■ ■ 7 


has, for the moments about the mean, 

Pa m, = w, p 4 r/?(l + 3w), ps = ^(1 -h lOw), pe == m(l -h 25m -f 15m2)^ 

3.4. Show that for the distribution whose frequencies for variate-values 0, 1, . . . J, . . . 
are the successive terms in (J + i.e. (J)” |^1, ‘ ‘ cumulants of odd 

order except the first vanish. 
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3.5. Show generally that the cumulants of odd order vanish for any symmetrical 
distribution, except the first. 


3.6. Show that may be expanded in an infinite series, valid in — oo < .r <, oo, 


.[ 2 ] 


.[rl 


2! rl 

the factorials being taken with unit interval; and hence that 

Mir] = K^(0J/ 0 

d 


where 


d ^ 


d(e^^y 


Hence show that, for the binomial (q f />)" about the origin, 


/“m = «‘'y- 


3.7. Show that the distribution whose frequency at the variate-value ± 2r (r integral) is 


2 


r2H 


f 


0»(2r)» 1^(2; 4- 1)’ 2’(2r -f- 2)! 


4 - 


and at (2r 4- 1) is 


7*2/ f { 


4 , 

\(2r ^ 1)' l'(2r ^ 3)' ^ 2i(2r f 5) 


+ 


7*2/4 "> 

Z T 


...} 


has odd-order cumulants equal to zero and even-order cumulants equal to 2a. 


3.8. Show that 

for the distribution 





dF - 

1 

e dx, 

G 

0 < x’ < 00 




=- 

a^{r - 1): 



3.9. Show that 







/b 




and hence that 






1 

1 

0 

0 

0 


/^2 

O' 

1 

0 

0 

K, = (- 1)--1 ^ 

/^3 

(o)"' 


1 

0 


fl'r ^ 


V - 1\ . 

1 


■ C - i)" 
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MOMENTS AND CUMULANTS 


3.10. Show that for the' distribution 

dF = dx, 0 < a: 1 

grouped into an integral number of intervals of equal width h, the corrections to the second 
and fourth moments about the mean are 

- . 

+ Y2 

tU = + At.jg + gQ. 

(Cf. Elderton, 19386. Note that the first is exactly, and the second approximately, the 
Sheppard correction %vith sign reversed,) 


3.11. If stands for the operator such that 

— 0 ^ < P 


and djp is distributive when ajiplied to products, e.g. 

d^,{AB) ^ B(d^A) + A{dji). 

show that 5^, annihilates every cumuJant (considered as a function of the moments) except 
and that 


(Cf. Kendall, 1941.) 


3.12. If f(x) is an odd function of x of period show that 

f lupr '‘^‘(log 0 ^) dx = 0 

J 0 

for all integral values of r. Hence show that the distributions 

dB = X ^ {1 — A sin (27T log x) }d,r 0 < t " oo 

0 : A 1 

have the same moments whatever the value of A. (Stieltjes. See refs, to Chapter 4.) 


3.13. Show that if the frequencies of a discontinuous distribution are distributed 
It 

at equal intervals w in each grouping interval 6, the average grouping corrections to 
the cumulants are given by 



(Cf. Craig, 1936.) 


3.14. Liapounoff’s inequality for moments. Beginning with the inequality 

{Eab)^ < {Za^){Eb^) 

show that for positive values 
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Hence that 

is true when p is of form Hence show that it is true for any integral p by noting that 

if 2^ is the smallest power of 2 greater than p we may take 


ai-j- . . , a.> 

1 - - 2 — * • * ~ 

Hence, putting p == « — c, = . . . c, & = • • * show that 

«/i“C , f 

'r 'a • 

(The inequality remains true for a continuous variate, as may be seen by considering limiting 
processes.) 


3.15. Show that for the bivariate distribution 

1 J (yf 2pa;i.r* , ; i 


2:^10,02(1 — p*)* 


2(1 


Cf \(J 2 


all cumulants r, .<< > 2, vanisl) ; and further, if 


^rst 


ffr 






_ (2r)'(2.s)' yi 
-^ 2 ,, 2 s 2 rH ■< Zj (r - 


(r — j)'(« j)’(-i)' 


CX^ , tJC 3 


(r 4- A‘ - l)p/l,-i, s 1 -t (»■ — 1)(^ -2 <-i 

(2r)'(2.s)' ^ (2p)'‘' 

0 


_ (2r [ 1 )’( 2 .V f l)t yi ( 2 p)^ 

'‘‘■J- M, 2sO ^ ('■ ^ 

^ 2 f, 2 . 11 — ^ 2 r I I, 2 s — 


whei’e i is the smaller of r and In particular, 

All - p. A,, =- 3p, A„ = KV, A„ - lOsV, =lo, = !)-15p ; 
A 22 = (1 + 2p2), A 24 - 3(1 4p2), A 2 . = 1.'>(1 f 6 p 2 ) 

^28 -= 105(1 + 8p2), A 2 == 045(1 + 10p2) ; 

A 3 . = 3p(3 1- 2p=“), A, 3 = 15p(3 -f 4p=). 

A 44 = 3(3 + 24p* -t 8 p*). 


00 



CHAPTER 4 


CHARACTERISTIC FUNCTIONS 


Moment- and Cumulant-Generating Functions 

4,1 • In the previous chapter we considered the characteristic function 

^(/,) = r (IF = . . . . (4.1) 

J r\ 

as a moment-generating function. We have also 

V(0 =log.^(0 .(4.2) 


y>(t) being known as the Cumulative Function. It generates the oumulants in the same 
way that the characteristic function generates the moments. If the moment of order r 
exists, ij>{t) can be expanded in powers of t at least as far as the term in {ity, and so can y){t). 
Other functions can be constructed which generate the moments. For example, 
since for | | <1 


we have the formal expansion 


1 


I — tx 




I 


dF 
_«,(! - tx) 




y-0 


(4.3) 


Generally if a function !^{t) can be expanded as a power series in t, Zaf we have, subject 
to existence (and convergence when the series is infinite), 


Since 



(4.4) 


we have 


(1 + fY = X 


7- 0 





(I -f- tydF -= 


oo 

/-(» ^ 




(4.5) 


and thus co(t) may be regarded as a factorial moment-generating function. We may also 
define a factorial cumulant-generating function 

log «(<) = i: .(4.6) 

though this function has not come into general use. 


4.2. The generation of moments is by no means the most important property of the 
characteristic function, and in this chapter we discuss some of the theorems which give 
it a fundamental place in statistical theory. 
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We recall, in the first instance, that always exists, since 


dF 


^ao 

dF 

J — oo 


• (4.7) 


so that the defining integral converges absolutely. Further, 4>{t) is uniformly continuous 
in t and differentiable j times under the integral sign if the resulting expressions exist 
and are uniformly (onvergent, for which it is sufficient that r, exists. H'or then 

1 I - i r Jr'e'^^dF I 


; f \x>\dF 

J jO 


The Inversion Theorem 

4.3. We now prove the fundamental theorem of the thf vy of characteristic functions, 
which will be called the Inversion Theorem, namely that the characteristic function uniquely 
determines the distribution function ; more precisely, if ^ \t) is given by (4 1) then 

F{x) - F(0) = I . (4.9) 


. (4.9) 


the integral being understood as a principal value, i.e. as 




Further, if F(x) is continuous everywhere and dF = f(x) dx 




. (4.10) 


the integral, as before, being a principal value if there is not separate convergence at the 
limits. Equation (4.10) may be compared with the form 


=i: 


f[x)e*^^ dx, 


. (4.11) 


the comparison exhibiting the kind of reciprocal relationship which exists between f(x) 
and 

As a preliminary we require an integral due to Eirichlet It is easy to show that 


Putting 


^ 1^111 U I 


”■ -1 


we have 

J == Uq — + Uz ^ . . + (— lY'U'r -4 • • - 

in which the terms decrease monotonically to zero in absolute value. Now let H{x) be 
a positive decreasing function. Consider 

/•'*> /^\ ein nr _ fx\ 1 sin x \ , /. 




(4.12) 
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Writing Jff (+ 0) as the limit of -&(«) as 4 S 0 (e positive), we have, in virtue of the decreasing 
property of JET, that any term in the series on the right in (4.12) is not gi'eater than (+ 0). 


Further, as the series alternates in sign, the difference between and 



is less than 0), which tends to zero uniformly in 7i. Consequently is uniformly ' 

convergent and we have 





Similarly we have 




(4.13) 


lim r nf-Y'^-dx 0) .... (4.14) 

p —►‘ocj—ot) \P/ ^ ^ 

By a simple change of sign the results are seen to be true if H{x) is a negative increasing 
function. It is therefore true of any function which can be expressed as the sum or differ¬ 
ence of a positive decreasing function and a negative increasing function, and in particular 
of a fi'equenoy function or distribution function. 

Adding (4.13) and (4.14) and writing H{0) for 4{/f(4- 0) -f — 0)] we have 


lim r .... (4.15) 

and putting jjx for x in this expression, 

lim r i/(x)- 7rfl(0), .... {4.1()) 

p —>• OC J - CO ^ 

the so-called Dirichlet integral. If H{x) is continuous at x = 0 the value 


i{i/(4 0) ^ ())} 


is of course the usual value H{x = 0). 
Now consider 


Putting 


./, j' ^«) d£. 

<f>{t) = f e’'-^dF{x) 

J - <X) 

.7^ = 1'' 


(4.17) 


we have 

The product in curly brackets may be equated to the double integral 

C f dF{x) cU 

J 0 J “OO 

which is evidently uniformly convergent. Making the transformation 


we have 


y --^x — £ 
2 = f 


f e"*' dF {y + z) dz 
0 J 
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and integrating with respect to z, 


= f e'*«{F{y ^ X) - F{y))dy. 

J — QO 

This also is uniformly convergent in t and heiKie, integrating under the integral sign with 
respect to we have 

,r ' X) -Fin)],In ^ . . (4J8) 

J - OL // 


since cos ry is an even function. 

Now (4.18) is a Diriehlet integral and we have, therefore, 

lim J, - 27 T{h\X) - F{h)}. 


Keferrijig again to (4.17) we thus have, wnting now .r for X 


F{x) - jF’(O) - ^ hm r M)dtVe 

27T , _v <x J . J (I 


(Ik 


. (1.19) 


and integrating with respect to 

j ff ] _ 

F{,r) - F{<)) - ' Ihn ^ 

-71 ( —^ r J < 

which is The result stated in (4.9). It is to be remember(‘d that in virtue of our convention 
in aniving at (4.16), i^(^) at a saltus is i{F(x -f) + F{x —)] 


4.4. This expression may be thrown into an alternative form. From the definition 
of it is seen that cl>(f) and </>(— f) are conjugate quantities, and thus have 

m - i wo 4 <^( ‘ 0} 

J(1) -<^(-03. 

It and I being the real and imaginary parts of Thus 

1 - e 
?/ 


F(x) » F{()) 


. If 

27rJ 


<A(0 


ixt 


cU 


and by a change of sign in f, 

1 

I ehl ~ t\ 


ir 

2jrJ. 

^ 1 1 r 


<A(- t) 


pixt 


if 


(It 


J I 

^ 2 r* R{t) B\nxt H i(0(l 
2jiJ t 

This integral is, of course, real. 


Ht) 


Bin xt\-dt 


it 


. (4.20) 


4.5. 


If now F(x) has a derivative /(x) we have 


/(a-) == 


1 d 

271 dx 


lim 



It 
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The integral being uniformly convergent in the differentiation can be carried out on 
the integrand, and we have 

the integral being a principal value. 


4.6. Consider now the expression 

. 

If the distribution function F lias a derivative /, this is equal in the limit to 

lim -<• = Urn ^/(x) = 0 
2c 2c''' 

and consequently tends to zero everywhere where F(x) is continuous and differentiable, 

i.e. if the frequency-distribution is continuous. 

If, however, the distribution is discontinuous, consider one point of discontinuity, 
say the frequency at The contribution of this part of the frequency to ^(t) will be 

and thus the contribution to will be 


_ 1 «r ~]c 

~ - x)j_, ■ 

If a: Xj this clearly tends to zero ; but if x ™ Xj it becomes 

Thus the function tends to at x = x^. 


Hence, if 


Jc 

2c 


tends to zero at a point x, there is no discontinuity in the distribution 


function at that point ; but if it tends to a positive number fp the distribution function 
is discontinuous at that point and the frequency is fp This gives us a criterion whether 
a given characteristic function represents a continuous distribution or not. 


Example 4.1 

We found in Example 3.10 that the characteristic function of the normal distribution 

1 

dF = — 7 — e dx ~ 00 < X < 00 

oV27r 


is 




Suppose we are given such a function and require to find the distribution, if any, of which 
it is the characteristic function. 

In the first place we note that the distribution, if any, is continuous. For 




ecr* 

dt. 
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The integral is less in modulus than \ e ^ dt which is less than e~ r dt ^ y ~ 

^ J-C o' 

Thus everywhere. We have then for the frequency function, if any, 

Roc) = e 

This may be regarded as an integral in the complex plane along the line j)arallel to the 

%oc 

real axis. Taking ta ~ the new variable in place of t, we find that the integral is 

in fact -1 e dC ~ —. 

(JJ tT 


This is everywhere positive and | dF converges. Hence it Is in fact a frequency function 
with the given expression as a characteristic function. 

Excnnple 4.2 

To find the frequency function, if any, for which 

== e~' ^ 

We note that tends to zero and that the distribution, if any, is continuous. We then 
have for /(.r), if it exists, 

1 

/(‘^O I ^ ^ 

•^ 71 J _ cr, 


1 r 

27rJ 0 J-or 

1 

I e -f e di 

1 c 

I e ^ cos fx di. 

^Jo 


fO 

J —ori 


This may be evaluated by two partial integrations. We find 


If* ”1 f 

fix) cos/x — I sin tx 

n\_ Jo ^Jo 

= ' -i.^re-sin/x-T-'^rc-cos^rrf/ 
^ Jo ^Jo 


x^J{x). 


7i(l -f :r^) 


oo ‘. oo. 
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As before, this function can rejjresent a frequency function, and it is readily verified that 
f{x) has, in fact, the required characteristic function. 

Example 4,3 

Does there exist a frequency function for which 

<l>{t) = ? 

We have 


i 

2c, 


p ({f J: r 

J-c 2rJ_c 


If 1 *“ X is not zero the integral is 

|* fcos {(1 — x)/} + i sin {(1 — x)tY\dt, 
Since sin t is an odd function this is equal to 


This does not converge, but it is bounded and hence 
If, however, x ” 1, the integral is simply 




0. 


and thus — 1. 

2c 

Thus there is unit irequency at x == 1 and it is seen at once that this accounts for 
the whole of the frequency, bo that there is no frequency elsewhere. The distribution 
tluis consists of a unit at x = 1. This is otherwise evident from the consideration that 
log </>(/) ^ it, so that the second cumulant is zero and there is no dispersion. 

Example 4.4 

For what distribution, if any, are the cumulaiits given by Kr = (r — 1)! ? 

The series 

yi {ny ^{uy 




.? 


converges absolutely for | / | < 1 and is thus equal to '^)(^) if such a function exists. We have 

.{ity 


ip{t) = = — log (1 — 


and thus 


m 


I 


(1 - U) 

If the frequency function exists we have 


J(^) 


1 r 

271 J. 


-ixt 




- dt. 


This integral may be evaluated by integrating the complex function y —r- round a contour 

1 — tz 

consisting of the real axis and the infinite semicircle below that axis. The first part reduces 
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to the integral we are seeking. On the semicircle of radius B we have z = R{cos 0 + i sin 0 ) 
and the integrand becomes 


e 3 cp (— ixR cos 0 -f xE sin 0) 
1 — iR cos 6 -f- iR sin 6 


6 here lies between 7t and 27t and hence sin 0 is negative. Hence ifx is positive the 
is less in modulus than 


expiession 


~R ' 


i.e. tends to zero as i? —> oo. 

^—ixz 

Now the function - -has a pole within the domain of integration at z = ~ i and 

the residue there is e Hence 

.f(x) =- 

= 0 < X oo. 

g- ixz 

More generally, if = 2 ^^' “ 1)K V '> fouu'i that tlie residue of - “ - - 

(1 — XZ) 

is ,,, , , so that the distribution is 

ip) 


fix) 




0 <r r oo. p '> 0 . 


i\p) ’ 

Exainplf 4.5 

For what distribution, if any, are all cumulants of odd order zero and those of even 
order a constant, say 2(i i 
We have 




This series converges and 
Hence 


y>{i) = 2a(cos / — I) 

r*' 

If we try to integrate I in fji 0 ordinary way we fail. Let us 

then look into the question of continuity of the distribution function. 


We have 


■ ® cos'< 


The series is uniformly convergent and hence 


^ COS H df 


since sin xt is an odd function. 
A.S. 


~ cos H cos xt dt, 
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Consider now the integral I 2^ cos H cos xt dt. By a well-known expansion 

J —OD 

2^ cos H cos xt = |(e‘^ -j- e f 

=- ^(6“' 4- + . . . 


p~llt 


The only part of this expression of present interest is the constant term, the others not 
contributing more than a finite amount to The coefficiemt of e® is zero unless x is integral 
in absolute value, and in that case is 


J 




Thus tends to zero unless x is integral in absolute value, and in the latter case 


Jc 

2c 


i J' 


^ J > 

j - 

. 2 , 


oven, 

say 2/*, the 

frequency at x — i 2r is 

r a'^" 


^2r J 2\ 

, ,2r ^ 4\ 1 

\(2r)l 

(2;- i 2)1 \ 

. 1 ; 

• (2/- ^ 4)'V 2 ; ’ ■ / 




2r 1 2 ^ 

l2r)\ (2/- f l)'l' * {2r 2)'2i 


and if x is odd the frequency at .r = 2r + 1 is 


/2r M 


+ 


{ 


-f 


,2/ f 


\(2r f 1)! (2r + 2yV (2r + :i)’2 


i 


We may now verify that these frecjuencies account for the vhole of the characteristic 
function and hence that all frequencies have been found. 


Conditiorus for a Function to be a Characfe?'idic Function 

4.7. Any function which is not negative in its range of definition and which is 
integrable in the Stieltjes sense can be a frequency function ; and any non-decreasing 
function which increases from 0 to 1 in its range of definition can be a distribution function. 
There are much more restrictive conditions to be obeyed before a given function can be 
a characteristic function. 

In the first place, let us note that it is a necessary and sufficient condition for a function 
^(/) to be a characteristic function that 


F{x) = 



-Lxt 


7t 


dt 


shall (except for an additive constant jP( 0)) be a distribution function. This, how^ever, 
is not a very helpful criterion in practice. 
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Looking to the definition of ^{i) as | e^^dF, wc see that necessary conditions for 

^{t) to bo a characteristic function are 

(а) that must be continuous in t, 

(б) that ^(t) is defined in every finite t interval, 

(c) that <^(0) = 1, 

(c/) that ^(/) and ^(— t) shall be conjugate quantities, 

(e) that I ^(0 i < f | dF < 1 - <^(0). 

j — 

These criteria enable us to reject certain functions as possible characteristic functions, 
but there do not appear to be any readily apj)lioable sufficient conditions which enable 
us to determine at sight wdiether a given function can be a characteristic function. 

Limiting Properties of Distribution and Clmract eristic Fund lorn 

4.8. Suppose there is given a sequence of distribution functions F^fv) depending 
on a parameter n which can increase indefinitely. To < ach thc're will coiTesx)ond 
a characteristic function The question to ^)e discussed is this : if tends to a limit 
F, will tend to a limit ^ and is <f> the characteristic function of F ? (^inversely, if 
tends to a limit does F^ tend to a limit F and is F a distribution function having (f> for 
its characteristic function ? The answers to these (questions, as will be seen below, are 
afiirmative under certain general conditions. 

It is to be noted what is meant by a distribution function tending to another. If 
both are continuous, is vsaid to tend to F{x) if, given any r, there is an r^o such that 

I F,X.^) - F{x) I -r t for all n no. If there are discontinuities presemt, F^^ will be said 
to tend to F if it does so in every point of continuity of F. Since by definition our functions 
are taken to be continuous on the left at saltuses, this evidently conforms to the definition 
for the continuous case and to the common-sense requiremtmts of the situation. 

4.9. We rccj[uire two preliminary theorems for later work. The tirst is that if F^ 
tends to F it does so uniformly. 

For the range can be divided into a finite mimlKw of parts, say at <^2 . . . such 
that — F(Sj) for all j. TJien u increasea there will come a time wlioii 

j < for all j. Thus'there exists an such that for n V «„ 

I F„(£,) - F(S,) I 

It is sufficient to show that this implies that foj’ any x 

\f\M) -F(x)\<:t. 

In fact, if X lies betw'een fy and , 

F(£,) s. W d I 

and 

F{S^) - ^ . F„{S^) - F„{x) . <, F {£,, ,) 1 2 < ^ 

and thus -- e F,fx) — F{x) < e, 

which is the required result. 
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4.10* The second theorem we require (the Montel-Helly theorem) is that if the 
sequence F„{x) is monotonic and bounded for all x (which is so for distribution functions) 
then wc can pick out a subsequence (a:) which converges to some monotonic increasing 
function F (not necessarily a distribution function itself, for it may not vary from 0 to 1). 

Consider first of all a series of values Xi, . . . It is known that every bounded 
set of numbers contains a convergent sequence. Hence we can pick out from the sequence 
F^{Xi) a convergent sequence, say, Then from the subsequence (xj) we can 

pick out a subsequence F^^J^x^) and F„^(x) is thus convergent at both Xi and x^. Continuing 
in this way we may, by picking out the first function in F^^^{x)y the second in F^^{x), and 
so on, arrive at a sequence of functions Oi(x). (^^(x) . . . which converges at each of the 
vahies ^ 2 ? • • •» ^tc. This is the so-called Weierstrassian diagonal process. 

It follows that the sequence is convergent at every rational point x. Since 
< G,Xx) < ^ 7 i(^) for every rr between a and b, we see that if 0^(a) and G^(b) converge, 
the limiting values of G^J^x) Jie between those limits, say G(a) and G{h). 

Then the function u{x) = upper bound of Gj^{x) {x not necessarily rational) is 
well defined and non-decreasing and so has no more than an enumerable number of points 
of discontinuity. If u is continuous at rr, we take y and 2 such that y <z x c z and 
u{z) *— u{y) < e. Then if a and b are rational points such that y <. a <, x <z b <i z it 
follows that u{y) < G(a) < G(h) < uiz). Moreover, as all the limiting values of Gfj^{x) 
are between G{a) and G{b), they are between u{y) and v{z). Hence, as e can be arbitrarily 
small, we see that G(x) tends to u(x) at every point of continuity of n. Finally, by the 
diagonal process, we can select a sequence which will also be convergent at the points of 
discontinuity of u{x). The theorem is established. 


The First Limit Theorem 

4.11. We now i)rove the theorem : if a sequence of distribution functions tends 
to a distribution function F, then the corresponding sequence of characteristic functions 
tends to ^ uniformly in any finite /-interval, where ^ is the characteristic function of F. 
It is required to prove that, given e, there is an 9?o independent of t such that 

1 — ^rSf) 1 = I f e'^(dF — dF„) | < f, w > «„. 


Select two points of continuity of F, X and — X. We can make X as large as we 
please. We then split the integral 


f" eJ^^{(lF - dF^ 

J _oo 


, (4.22) 


into two parts, that in the range — X to -f- X and that in the remaining portion of the 
range. Now 

I e^^^dF < dF < 1 - F(X) - F(- X), 

and by taking X large enough we can make tliis quantity less than 


Similarly 


rx>X 

dF^ 

Jx<X 


<1 ^ F„(X) ^ F^i-^ X), 
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and since F„ tends to F (and that uniformly) this, for some large X, will be less than 

£ 

Hence for some the portion of (4.22) outside the range - A' to 4 A' will be less in 

€ € C 

modulus than ^ 4 - - =r Consider now the other part 

J - (1F„) . (4.23) 

This expression is the limit of the sum 

- {F,.(.Vi) • . .(4.24) 

being the boundaries ol the interval into whieh the range i* subdivided and 
a value in that interval. The difference between this sum and the limiting value can be 
£ 

made less than - if the intervals are small enough ; for if the> are less chan rj in width the 

difference of and is less in modulus than rj\t\, by the mean vaiu^^ theorem, and 
thus ill any ^range ± T the difference of (4.23) and (4.21) ti Jess in modulus than 
yT I ~ ~ F,{i,)}] | < 2.y7’ 

f . e 

which is less tlian ^ if // <, 

Now the sum (4.24) will itself be less than ^ for some n n^, for it is the sum of a finite 

4 

number of terms each of which tends to zero. 

Consequently (4.23) is less than and hence 

I -A (0 - ^«(0 I < f. n a„. 


Converse of the First Limit Theorem 

4.12. The converse result is c'vcn more im[)ort<int 

Let be a sequence of characteristic functions eorresjionding to the secjuence of 
distriViution functions F^^. Then if <^„(0 tends to (f)(() uniformly in some Unite /-interval, 
F^ tends to a distribution function F and ^ is the characteristic function of F. 

As a preliminary lemma, let us prove that if is a distribution function vith char¬ 
acteristic function <f>, then for all real ^ and all h 0 




In fact, put 



This is a continuous distribution function and its characteristic function is 


’f c>-dQ 

fij-or, 



[F(t 4 h) - F(x) }(/.»•, 
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which by a partial integration becomes 
ir{F(.c f h) - F{x)}e^^ 


/^L 


It 


= HD 


*] — \ f {dF{.r + h) — dF(x)} dx 

J»Wj-oo 

;; 1 r dF(x) - dF(x )} 

ith j ~ cf) 


I ^ e 
ith 


-ith 


Substituting for G{x) in (4.9) we get 

] \ 2/j 

-\ F{v)du 
f‘hih 


ip-lA 
thl\ 2 


1 p /I P 


F{n) dn 
- dt, 


whence, writing f for f J- 7/, we find 


1 (■■ + '' 

/Ji 


F{n) dit 


“Xl')"' 




(It 


the result announced in (4.25). 

Reverting now to the theorem required to be proved, note that it is sufficient to establish 
that if ^ <f) uniformly in kSOVip inierval | / | < a. then tiuids to some distribution 
function F in every point of continuity of F. When tliis is estaldishcd it follows from the 
First Limit Theorem that cf} is the characteristic fuiiction of F and that converges to 
<f) uniformly in every finite ^-interval. 

As shown in 4.10, given a sequence we may always choose from it a subsequence 
F^f such that F^> converges to a non"decreasing function F in every continuity ])oint of F. 

Let us then choose such a sequence. W<* have of neei'ssity 0 " F 1, and F may 
tie supposed everywhere continuous on the left. It is then a distribution function if 
F(+ go) — F(— co) — 1, and this we proceed to prove.* From (4.25) with — 0 wo have 

- y" /"■<"' '"'-iw ("r) ’^“0') 

By hypothesis tends uniformly to cf} for | / | a and hence does so, and it is easily 
seen that the integral on the right is uniformly convergent. Tlius, given we can find 
Jiq such that for h'> 




-h //, 


* It is not obvious that if tiie functions F„ all vary from 0 to 1. then their limit must do so. In 
fact, if F„(.r) — 0, .r < — n, F,t(,r) ~ I, — n< x < n, F^(x) ~ 1, x > n then hm F„(.r) ~~ J for 


00 < .T < 00, 
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where \r] \ < r. Now let h tend to infinity, Ab F is a non-decreasing function the left- 
hand side tends to F(-f oo) — F( — oo). The right-hand side tends, in virtue of the 
uniformity of and the consequent continuity of near i = 0, to 


ir Ainjy 


dt, 


which is equal to unity. 

Hence F, the limit of the subsequence is a distribution function whose characteristic 
function is (f>. 

But any subsequence of tends to (f>, in virtue of the uniformity of the convergence, 
and hence any convergent subsequence of F^ tends to F. Consequently F^ tends to F in 
every point of continuity of F and the theorem follows. 


Example 4.0 

The binomial distribution {q + pY^ considered in Exan pie 3.2 has the characteristic 
1 unci ion 

{q +pe^r. 

Now the frequency at j: —j is This gi eater than the ordinate at 

a* = j 1 if 

or j ^ pn - q. 

For large n the maximum frequency will then be in the neighbour! lood of J - pn, and 


is then 


\pn) 




In virtue of Stirling’s a])j>roxiination to the factorial this approxiiixat'^'^ to 
(pn)P'^e-{•2Ti2)ii){qnY‘"c <"'\ (27njii)'^ 

and therefore tends to zero. 

Thus every frequency in the binomial tends to zero and the distribution docs not tend 
to any limiting distribution. 

Suppose, however, that we express the distiiliution in standard measure. I utting 
f ^ have 


pOO 


f /f, ) 




J 


dF{x) 

/ 1\ 

Hence == e ^ 

The effect on ^(t) of transferring to standard measure is then to replace t by - and 

iifix 

to multiply by e . 



104 


CHARACTERISTIC FUNCTIONS 


For the binomial == np, jWg == npq, and thus the ohatacteristio function of the 
binomial expressed in standard measure is 

it Y 


exp 


Thus 


ifnp \/ 

(«pg-)*/V 


H- p exp 


(7?m)V 






log I 

1 (pify ) 

2 npq / 


, , a pP , pOf'^ 
(npq)^ 2vpq 




[npqy 

— itnp 

(npq)i 

pt^ 

2npq 

Thus for any finite t log tf> tends uniformly to — and hence 


0 <101 <1 




^(0-^e- 


•H' 


Thus the distribution (q + pY expressed in standard measure tends to the distribution 
whose characteristic function is e' i.o. to the form 


dF = e 
\/{2n) 


OO ^ X ^ CO. 


Multivariate Characteristic Functions 

4,13. The characteristic function of a bivariate distribution F(.ri, x^) is defined as 


<^«1, <*)=r r a:.) 

J - QO J —OO 


. (4.26) 


and generally, that of a multivariate distribution F{xiy rg, . . . x^^) as 

■ -t,,) = r r . . . r . .xj (4.27) 

J—ooj XJ J~<X) 

If Xi, x^y . . . are independent we have 

f ■ f F'’'"'drF„{x„) 

J — OO J — » 


4>(txi izi . . . - J 

Similarly 




n 

^ ^ log 


. (4.28) 


(4.29) 


?*» 1 


Thus the characteristic function of the joint distribution of a number of independent 
variables is the product of their characteristic functions ; and the cumulative function 
is the sum of their cumulative functions. This is a fundamentally important result in the 
theory of sampling. 


F{xt, Xg, 


4.14. In generalisation of (4.9) we have 

1 _ 


^n) 


(2^) 


1_ r pi— 

‘ ‘ J-oo ~it~ 


I — c 

Hr,. 


aXrdn 


^ 2 j • • • tri) . . . dt^. 


. (4.30) 



multivariate characteristic functions 

The multiple integrals are to be interpreted as principal values 

C 00 J J ^ 

Th© proof is similar to that for the univariate case. We have 
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r ...f 

Jo Jo 


Sin Xi 
^1 


sin 


dx, . . , dx^ ~ 


Jim f” 

•f 

“ h(^\ . . 

^ x^ 

. .. dx, 

p -OC J — GO 

J 

-00 \P 

■ p) X, 


lim r . 

..r 

H(x„ . . . 

. sin px. 

X,) - . 


P -C» J — 90 

J 

00 



Considering 

now 




re rc 




rXn 

II 


• • • • 

..d/„ .. 


J -C J 



J 0 

J 0 

we find that 





II 

8 

. , 

f” 2ainra:, ^sin^c.r„ ^ ,, 

J 

30 

J —CO 1 

Jl 

n 

liin = (2jr)'* 

{F(r„ 

. . . .r„) 

~ F{0, . . . 

0)] 


H- 0) 


and by considering the integration of (4 31) with respect to the ^’’s th(' result (4.30) follows. 

4.15. If we have a distribution F{x) and some function of the variate such as ^{x) 
we may consider the characteristic function of | 


^^(0 “I dF{x) 

given by (4.9) or (4.1 

== A [ ^xp (- dt. 

■^dfj _ 0 , 


(4.32) 


The distribution of | vill then be given by (4.9) or (4.10), e.g. the distribution function of 
say 6/(1), is 

1 

, (4.33) 


The Problem of Moments 

4.16. We can now consider in more detail a problem which suggested itself in Chapter 
3. Do the moments determine the distribution uniquely, and if not, under what conditions 
do they do so ^ To give some point to this question let us note that in some circumstances 
it is possible for two different distributions to have the same set of moments. 

Consider in fact the integral 

f -qi ^ p 0, q .> 0. 

Jo 9. 

q ~ OL + 

^ = tan Att 
a 

i. 


Put 


n a non-negative integer 
0 < ;i < I 
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f 


and since 


We find on substitution that 

(cos tan -f- i sin tan } ^dx , . . (4.34) 

-) 

‘{1 +i tan 

, ., ^ X ^ ^ eos (n + l)jr \- i sin (/? I )7i 

-^tanA7^) == ~' 

(cos A:7T)^t^ ' 

— a real quantity, 

the imaginary part of (4.34) is zero. Thus the distributions 

f(x) “ + e sin tan Att) } .... (4.35) 

0 < if oo, a > 0, 0 < A <. I, I e I < 1 

have moments independent of e, and (4.35) defines a whole family of distributions having 
the same moments. 

Similarly, if we substitute 

PJf 2rS‘ 

tany^ , .r^ — f, p — “ positive integer) 


(2^^ fl) 

P ^ \ g ^ (X 

we find that the family 




f(j-) = Ice' 



2-s* 

2 

1 £ cos 

tan . 

2.S- 

a > 0 , 

0 < p = 

^ i + 1 


. (4.30) 


1, \c\<l 

all have the same moments, the range in this case being infinite in both directions. 


4.17, In full generality the problem of moments may be formulated as follows : 
Given a sequence of constants Co, Cj, . . . . . ., 

(i) Does there exist a distribution function F such that 

.(4.37) 

J a 

(ii) If so, is the distribution function unique ? 

(iii) What are the functions, if any I 

We have not the space here to enter on a full discussion of these questions, which have 
stimulated some beautiful mathematics, particularly by Stieltjes (1918). Our treatment 
will be confined to the results of statistical interest, but wo may indicate the principal 
results of Stieltjes. 

If we express the series 


!:< 

y-0 




as a continued fraction of the form 

1 1 1 


1 


1 


(4.38) 


(4.39) 


a^z 4- a, 4 a^z 4- o. 4- 
then, if the limits in (4.37) are 0 to oo, it is a necessary and sufficient condition for the 
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existence of at least one F that all the be positive ; and F is unique or not according 


as diverges or converges. 

1 


The case when the limits in (4,37) are i oo has been treated by Hamburger (1920), 
who showed that an F exists if the expression of (4.38) as a continued fraction of the form 


^>0 bx ^2 

-f - f (It -] 3 -f r/a 4 - - T 


. (4.40) 


gives positive values of the 6’s. In order that F may be unique it is necessary and sufficient 
that the continued fraction be completely convergent in a sense defined by Hamburger. 

We shall see presently that for finite limits in the integral of (4.37' the function F is 
always unique. 


4.18. Unfortunately the Stieltjos-Hamburger criteria .ire not of much practical use 
because*, as a rule, it is too difficult to express the a’s and 6’s of (4.39) and (4.40) explicitly 
enough in terms of the given c’s to enable questions of sign oi convergence to be decided. 
We may, however, derive some criteria of statistical importance by considering the more 
restric ted x^roblem : given the moments of a distribution, cun any other di8tri>)ution also 
liave the moments ? In other words, we aie given the existence of one F and require 
to know wliether F is unique. 

Note* in the first instance that this problem need only be considered when absolute 
moments of all orders exist. It is evident that more than one distribution can exist having 
a limited number of moments finite and the re^mainder infinite. Furthermore, if any 
moment of even order exists, those of lower order must exist, in particular, if exists 

J .r"'’ dF and J dF exist separately, and hence so J I ^ I 


fO 

1 


dF, and so also does 


I,.-. 


dF, the absolute moment of order 2r — 1. 


Thus wv consider only the case when all absolute moments exist. 


4.19. We will prove in the lirsl })laee the tlieorem that a set of moments determines 

V—1 V 1^ 

a distribution uniquely if the series > converges for some real non-zero t. 

The characteristic function is continuous in t and its derivatives exist if the moments 
exist. We have then in tlie neighbourhood of / U 


^(0 

7-0 


. (4.41) 


where i?, is less in absolute value than 


S.'F 


(3.14). 


Thus if converges, tends to zero and hence if>{t) is equal to the sum of the 


vAt 


r- 


EvA‘ 


infinite series if it exists. Moreover, this series is majorated by 

^—1 /! /• 


and hence 


y“0 
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is absolutely convergent if the latter is convergent. Hence we have 




{itYfi'l 


0 


and thus <f>(t) is uniquely determined in the neighbourhood of t 
of t = (o we have 


. (4.42) 

0. In the neighbourhood 



^ (IF 

00 


} 


+ -Rr 


and the modulus of the coefficient of 




is not greater than 




Consequently <^(/) 


can be expanded everywhere as a convergent Taylor series and is equal to the sum of that 
series. Hence 4>{t) may be extended from tlie neighbourhood t = t^hy analytic continuation 
through any finite /-interval. Hence is everywhere uniquely defined. 

But determines the distribution function and hence the latter is uniquely deter¬ 
mined. 


4.20. As a corollary of this theorem we have the result that a set of moments uniquely 
determines a distribution if 


lim ,♦ 


— is finite. 
n 


. (4.43) 


V P*' 

For the series convergent if 

that is to say, in virtue of the Stirling approximation to the factorial, if 

lim -V = lim ^et < 1. 

\ n” / n 

1 

If k is the upper limit of — this inequality will be satisfied for t 

CAT 

1 

Is is also a sufficient condition for uniqueness that lim should bo finite, a form 

h 

of the criterion which enables us to disregard the absolute moments. In fact 


so that 


2 w — 1 


V 2/1 _ / 2» „ 


1 

2n+l 


1 1 2m ] i , 2m + 1 1 -JL. 

2»+l 


2m -- 1 2»-i 2w — 1'2m'"2>‘ " 2w - 12n + 1'2«+1 

Taking upper limits throughout we have 

— 1 _L —-1,1 -- 1 J^_ 

hm -- V ‘-in-i < lim -- uL'i" < lim --v„ i 

271 ~ I 2 n-i 2'rv^^ %n 1 2/ifi 

~ ^ 1 1_ _1 , ^ 

and thus lim ~ and lim are finite or infinite together. 
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4.21. As a further corollary we have the result that a set of moments uniquely deter¬ 
mines a distribution if the range is finite. For suppose the range is a to 6. Taking an 
origin at a? == a and letting 6 — a = c, wo have 

dF < 

1 

Thus < c == 

~ y n 

and hence lim -- == 0. 


4.22. Two further criteria may be mentioned. The first is due to Carleman (1925). 
A set of moments determines a distribution uniquely if (in the case of limits — oo to -f- oo) 


diverges. 


CO 



1 

1 


For the limits 0 to oo the corresj)onding series is 


(4.44) 


oo 1 


(4.45) 


Secondly, if there exists a frequency function, the moments determine it uniquely 
if, for limits -- oo to -f- oo 


f(x) <M\x\ for I x I > jTo {M, /?,«,> 0 A < 1) . . (4.46) 

and for limits 0 to oo 


f(x) < M \ x\ ^ for \ x \ >- Xo (M, a, > 0 A J) . . (4.47) 

This result is due ultimately to Stieltjes. It follows without difficulty from the Carleman 
criterion. 

It is interesting to note that if for some x^ 

f{x) > e-”'-"'" (a > 0) . . . . (4.48) 


then the problem of moments is necessarily indeterminate (as usual, A < J for the range 
0 to 00 and A < I for the range — oo to + oo). This follows from the examples in 
equations (4.35) and (4.36), for we can add to (4.48), without rendering any frequency 
negative, a function all of whose moments are zero. 


Example 4,7 

The moments of the distribution 

• 1 „ 

dF ~ ^ e dx, — oo < .r < oo 

aV 271 


are given by 




P2r 


(2r)! 

2’'r! 


m 



no 
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Thus 


1 1 
n 


a 

_ _ _ j 

f(2M)!h 

n\/2\ 

1 / 

J 

•rc-2»( 

7t \/2j 

1 { ~e -~’ 

a 

2n 




n \/(2e) 
a 

"" 7/(2c)/i* 

and thuB the upper limit is zero and the distribution is unique. 
4.23. If the moment of order r exists it must be given by 


{i/r 


Thus if cf>{f) can be expanded in an infinite Taylor series, that series must be /V 


rl 


Further, if this series does not converge, (f>(t) cannot be expanded as an infinite^ Taylor 
series. But it can always be expanded in the finite form with remainder 


*(') - Z + -K- 


Thus, when the series does not converge, can be expanded in powers of / only 
asymptoticallj^, 

This illustrat€;B the source of the ambiguity in the definition of (f>(f) when the infinite 

series fi] does not converge, for it is known that theue exist an infinite number of 

functions which have a given set of coeflicients in an asymptotic expansion. For instance, 
if a(/) has an asymptotic expansion in t the functions a(/) + all have the same 

r (ifY , 

expansion. It is therefore hardly surprising that when 27 or 27 - | fail to converge, 

there may be more than one frequency or distribution function with the same set of 
moments. 

But it does not follow from what has been said that there 7nn6f be more than one 
frequency-distribution. There must be more than one function, but those functions may 
not qualify as frequency-distributions, e.g. they may be negative in jiart of the range. 
In the example just given, cannot be a characteristic function, for it does not obey 

the well-known condition that and </►(- t) should be conjugate. So for as T am aware, 

i'ifV r 

it is not known w^hether the condition that Hi should converge is necessary as 

well as sufficient for uniqueness. 


The Second Limit Theorem 

4.24. We are now in a position to prove a further theorem on the limits of distri¬ 
bution functions. If a sequence of functions F,,(a') has all moments existing and for all 
0 jUj^then the /q*s are the moments of a distribution function F which is the 

limit of the sequence j>rovided that F is completely determined by its moments. 
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We will first prove the rather more general theorem ; If there is given a sequence of 
distribution functions such that all moments of F^ exist, and for any j the sequence 
lies between fixed limits independent of then a subsequence can be selected 
from F^ such that 

(1) lim I dF^. exists, = fx] say. 

(2) The subsequence F^> converges to some distribution function F, 

(3) I dF exists and is equal to 

J *-00 

The existence of fx] may be proved by the diagonal method exactly as for the Monteb 
Helly theorem of 4 . 10 . By hypothesis, fXj{n) is uniformly bounded and the rest of the 
proof follows that of 4 . 10 . 

The existence of F follows also from the Montel-Helly theorem. We apply the theorem 
to the subsequence derived by satisfying condition (1) and hence arrive at a subsequence 
obe^ung both (1) and (2). It must however be shown that F is a distribution function, 
i.e. varies effectively from 0 to 1. This follows because 


/•X) 

J„ 


. xifj) 

I ^7*+^ ’ 


6 > 1 

a <i — 1 


. (4.49) 


and hence, for the subsequence, with r == 0 and letting n' tend to infinity, 


0 F{a) 


1 -+ K 


so that, as n. b tend to infinity the equations F{oo) ~ I, F{— oo) = 0 are seen to hold. 

We also require for later parts of the proof two results : the first that the convergence 
of 


lim 

a — b — 


I X’ <IF„ to I 


xi (IF., 


. (4.50) 


is uniform with respect to ti. This follows from the hypothesis that bounded 

and from the equations (4.49). The second is that 

lim x*{l — jF’jiIx)} — 0, lim | x* | F„(x) = 0 


. (4.51) 


for s > 0 and all integral n > 0. The first limit follows from 


and hence from 


5»{1 - FJb)} < fi'-. 


0, 0 < s < 2j. 


f* OO 

We now have to complete the proof by showing that j dF exists and is equal 

J ~-QO 
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to fJLj. For this we use the theorem (an extension by Frechet and Shohat (1931) of one 
due to Kelly) that if a sequence v„(rr), defined in the interval — oc to + oo, is such that 

(1) vj^x) is of bounded variation in any finite interval, 

(2) all and their total variations are bounded in any finite interval, 

(3) lim vj^x) = v{x) exists for all .r, except perhaps at a denumerable number 

n — 

of points, 

(4) j: fix) dv^(x) converges uniformly with respect to n to J f{x) dv(x) if f{x) is 

everywhere continuous, 

then 1 f{x) dv(x) exists and ~ lim j f{x) dv^fx), 

J —ac n —>-<»J "oo 

This result may be apjjlied to our sequence I\f(x), which obeys conditions (1), (2) 
and (3). It also obeys (4) when f(x) = x^ in virtue of (4.50) and (4.51). Further Fix) 

is of bounded variation and hence I x^ dFix) exists and equals, say, 

J - 00 


Finally 

I f'l 


x'{dF -di\) 

1 J - « 

' ^ j x^ (IF -III 

i J 00 j J — oo 


dFJ 


dF 


a < 0, 6 ^ 0. 


(4.62) 


By taking — a and b sufficiently large we can make the first four terms on the right as 
small as we please, for - a < - ao, b > 6o and wsome n > Wq- Then by taking n sufficiently 
large we can make the fifth term as small as we please (without affecting the smallness 
of the other terms). Hence | //^ — Pjin) ) may be made as small as we please. 

This establishes the more general result. The theorem enunciated at the beginning 
of the section follows as a corollary. In fact, if jn^in) tends to a limit then the 
subsequence F^^ can always bo selected and tends to a distribution function F with the 
moments /i'. All we have to prove is that if the are such that they uniquely determine 
F, the sequence F„ itself converges to F, 

Suppose that there exists a point of continuity .To such that F^fx^) does not converge 
to F(xo)‘ Then a subsequence F^^>ix) can be selected which converges to some other value 
at ^ 0 . But from this Fj,> we can select a subsequence F ^. conveiging say to F^ix), having 
the same moments as Fix). Since by hypothesis these moments uniqu€»ly determine 
F, F^ must be the same as F in all points of continuity, i.e. 

lim F,,,,(rro) =: F(to). 

n' —>-cx> 

This ivS impossible, for F^.(.ro) is a subsequence of F^^ix^) which converges, but not to 
F(.ro). 


4.25. The above proof can hardly be described as easy, though it depends only on 
simple notions such as continuity and convergence, but the Second Limit Theorem is so 
important that it has seemed worth while reproducing the proof in full. Many examples 
of its application will occur in the sequel. The chapter may be concluded with an 
illustration of its use in determining the limiting forms of distributions. 
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Example 4,8 

The discontinuous distribution whose frequency at a? ==^* (j 0, 1, . . ,) is e" 
has a characteristic function 

4>{t) = exp m{e^^ — 1), 
and hence all cumulants equal to m. 

The distribution is evidently the only one with such cumulants, for -- == mS-, - 

1 f- f 

is convergent and equals m(e** — 1), so that the cumulative function and the characteristic 
function are uniquely determined. 

Now as m tends to infinity the frequency at ^ jf > tei^ds to zero and thus the 

distribution does not tend to a limit. This is consistent with the behaviour of the 
cumulants, which increase without limit. 


Suppose, however, w^e express the distribution in standard measure. Then 

_ yn _ 1 

/Cj. ^ _ 2 * 

Kg" 


Hence as w —> oo all cumulants higher than the second t/cnd to zero, and hence the 
cumulants of the distribution tend to those of the normal distribution 


(IF = f/x, ~ 00 < a; < cx> 

\/(27r) 

with the mean wh 

Now wo know that this distribution is completely determined by its moments 
(Exam})le 4.7). We also know that the cumulants determine tlie moments and viee>versa, 
80 that if the cumulants of the discontinuous distribution tend to those of the normal 
distribution, the moments will tend to the moments of that distribution. Hence the 
Second Limit Theorem is apf)Ucable, and the discontinuous distribution does in fact tend 
to the normal form xk^hcn exjne.^sed in stmidard 7nm(>Hre. 


NOTES .\N1) REFERENCES 

The idea of the characteiistic function can be traced back as far as Laplace, but its 
introduction into the theory of statistics, through the theory of probability, is mainly due 
to Poincar6 and Levy (1925), whose book provides the most readable and complete account 
of the function. More recent researches are outlined by Cramer (1937). The proof of the 
First Limit Theorem is substantially that given by Levy. The converse, given originally 
in a somewhat less general form by L6vy, was proved simultaneously by him and Cram6r, 
the proof in 4.12 following the latter’s. 

The Second Limit Theorem seems to have been first proved by Mai’kolf for the case 

when tiie limiting form is the normal distribution dF = ^^*dx. Tt was subsequently 

considered and extended by several writers, the general form of 4.24 being due to Fr^chet 
and Shohat (1931), whose proof has been closely followed. Some references to prior work 
are given by these authors. 

The problem of moments ap];>ears to have been first considered and solved by 

A.S. I 
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EXERCISES 

4.1. Show that if a frequency function/(:r) is symmetrical the characteristic function 
is an even function, i.e. == </>( - /), and that therefore <^(/) is real ; and conversely, 
if €f>(t) is real the frequency function, if any, is symmetrical. 

4.2. Show that the function 

_ l\n 

— . — ) , n a positive integer, 
tl ) 

is the characteristic function of a distribution function 


nx) = - 1)« + Q(.r - 2)» . 


4,3. Show that the factorial moment-generating function c>(/) of the binomial {q -f p)" 
is (1 4- and hence that 


= P’’ 


4.4. If for a certain distribution 

Kj. = ha^, 

a and b being positive constants, show that the distribution is discontinuous with variate- 

e ~ *^6’’ 

values (),«,. . ., m, . . . and the frequency at ra equal to-’ 

r\ 

4.5. Show that the function e cannot be a characteristic function unless a » 2. 


4.6. Show that there is only one distribution with moments given by 


Mr 


^ _ r(r + r) 


r(v) 


and that it is 


^ dx 0 < a; < cx). 

riy) 
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4.7. A theorem due to Weierstrass states that any function continuous in the range 


(a, 6) can be represented by a uniformly convergent series 


of polynomials P„(x) 

o 


being of degree n in x. Deduce that if two continuous frequency functions, fj and 
have the same moments of all orders. 


f ifi — fi)^dx = 0, 

J a 

and hence that the moments determine a distribution uniquely if it is continuous and of 
finite range. 


4.8. If e is a non-negative function of the variate x and 

<x(t) =- f e‘dF(x), 

J —CO 

show that the frequency function of 0, if any, is given by 


m - 

271 % J 




4.9. Show’ that if a characteristic function <^(/) j)ORHesses derivatives up to and 
including the second order, then 



and generalise this result. 


4.10. A theorem of Denjoy {CompUs rendus, 1921, 173, 1399) states that if a function 
f(x) defined in a range (u, b) possesses derivatives of all orders, if is the maximum of 

I f(n){x) I in the range and if X ^ ^ is divergent, then f(x) is completely determined by 

its value and that of its derivatives at a single point. Use this result to show that a set 
of moments determines a distribution uniquely if diverges. 





CHAPTER 5 


STANDARD DISTRIBUTIONS—(1) 

5.1 • There are certain distribution and frequency functions which, for both theoretical 
and practical reasons, occupy a central position in statistical theory. In this and the next 
chapter we shall consider their properties, leaving their statistical uses to be developed 
and illustrated later in the book. We shall, however, indicate briefly some of the ways 
in which they arise, even at the expense of anticipating ideas introduced at a subsequent 
stage. This will not impair the logical continuity of our development and will give con¬ 
creteness to a treatment which might otherwise appear somewhat abstract. 


The Binomial Distribution 

5,2, Suppose we have a laige population of members each of which exhibits either 
some quality P or a complementary quality Q (== not-P), for example, a population of 
men who are either blue-eyed or not-blue-eyed. Suppose that the proportion of individuals 
with quality P is p and that with quality Q is g, where of course p f ^ — 1. If we take 
a random sample of xV members from the population we expect that on the average pN 
members will exhibit P and JVq will exhibit Q. We may thus array the members according 
to the quality as 

N(p + q)^ 

Now supiiose we choose N pairs of individuals. There will be pairs PP, pairs PQ, pairs QP 
and pairs QQ, Of the Np pairs for which the first member is P there will, on the average, 
be a proportion p for which the second member is P and q for which it is Q. Similarly 
for the Nq exhibiting Q in the first member. Thus the pairs may be ari’ayed as 

Np(p -f q) -f Nq{p +</)== N{p -f- qP. 


Generally if we choose N sets of n the array will be N(p q)'^, 
proportion of cases containing^' P’s and (n — j) Q’s will be 
in {p -1- g)^. We are then led to consider the binomial distribution 


That is to say, the 
, the term in 


/ === -H <7^.(5.1) 

as a discontinuous frequency-distribution, the variate being the number of P’s in the set 
of n, which may vary from n to 0, If, as is frequently more convenient, we wish to con¬ 
sider the variate as increasing from 0 to the distribution is inverted, i.o. becomes 


/ - (g + pr .(5.2) 


5,3. Distributions very close to the binomial form occur in practice, particularly in 
artificial experiments with coin-tossing or dice-throwing. Some data by Weldon are 
shown in Table 5.1. Weldon threw 12 dice 26,306 times and noted the values at each 
throw. This is equivalent to the drawing of samples of 12 from a large population. The 
occurrence of a 5 or a 6 on any die was regarded as the exhibition of the quality P, a 
success ” as we may call it. 
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TABLE 5,1 

Frequmi^y-disiHbution of 26,306 Throws of 12 Dice, the Occurrefice of a 5 or 6 being 

counted a Success. 


No. of 

Observed 

Theoretical Frequency 
from the Binomial 

No. of 

Observed 

1 

Theoretical Frequency 
from the Binomial 

Hucocbbos. 

Frequency. 

26,306 

Successes. 

Frequency. 

, 26,306 

0 

185 

(0*0023 -1- 0 3377)12 

187 

6 

__ 

3,067 

(0 6623 + 0*3377)»2 

1 

1 3,043 

1 

1,149 

i.ue 

7 

1,331 

r 1,3550 

2 

3,265 

1 3,210 

8 ‘ 

' 403 

424 

3 i 

5,475 

6,465 

9 

105 

1 96 

4 : 

6,114 

6,269 

10 and ovei i 

1 

16 

5 

1 

i 

5,194 

5,116 

i 

Total * 

! 

26,306 

26,306 


If the dice were perfect (a condition rarely realised in practice) the proportion p of 
suecesfecs would be ] : and the appropriate binomial woulvl be, in the form (5.2), ( 

In this particular case the dice were not quite perfect, the proportion of cases exhibiting 
a 5 or a 6 being 0*3377. Taking this as the value of p, we get the frequency function 
(0*6623 f 0 * 3377)12 'which when multiplied by the total frequency 26,306 gives the 
theoretical frequencies shown in the third column of Table 5.1. The agreement with 
observation is evidently fairly good. 


5.4. Taking our variate to be increasing, we have, from (5.2), that the frequency at 
X ~ is characteristic function of the distribution is then 


m - 


J 0 


O’- 




— {q I .... 

We then have for the moment of order J about the origin, from (3.11), 


/h 




and hence 


and so on. We find 


cP 




{q 4- I 

Jt- 0 

I 


and hence 


/q np 

np 7i{n ~ l)p^ 


npq .... 
npqiq ~~ p) 

p^ == ^n^p^q^ -\~ pq7i{i — iSpq) 


71 


— /li 


P 


pz (^pq)^ 




npq 


(5.3) 


(5.4) 

(5.5) 

(5.6) 

(5.7) 

(5.8) 


(5.9) 
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5.5. Further formulae are not often required, but when they are can be derived 
from some interesting recurrence relations connecting the moments of the binomial. 

Writing d — if we have, for the characteristic function referred to the mean as origin, 

,^{t) = c t- pe!>)” .(5.10) 

Differentiating with respect to 0 we find 




— + pe")” + we •’"'"(q' + pc")''"’ 


M 

-wp2^ 


i! 


+ - 

9 


ri'pe*^ ^ fi/P 
jte« j! 


and hence, after a little re-arrangement. 


(7 + pe°)| - ^-PV(e" 

Identifying coefficients in we. get 







(5.11) 


giving the moment of order r about the mean in terms of those of lower orders. 
Furthermore, writing the moment about the mean as 



we have, differentiating with respect to p, 

= — rni:(j- npy-'QJq^-’pf — 2^(j — f “(j —'npy(^^<f~‘jl>‘~'^- 

The first term on the right is — rwThe sum of the other two will be found to be 
- npY^^(^^q'‘~Y -- Hence we find 

-+ .(5.12) 

For example, //i ™ 0, - p) and hence 


//g pq[tt — 2np] 
npq(q - p) 

as stated in (5.6). 

For factorial moments the expressions assume a particularly simple form. In fact, 
differentiating (q p^ r times partially with respect to p and multiplying by p^ we have 


v^^\q -f p)'^-^p^ 





Pm > 

q 2 ) ^ I 
fhn = w''-y. 


and hence since 
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5.6* If jp = g the binomial distribution is obviously symmetrical. If p 9 ^ q the 
distribution is skew. But in both cases it will bo unimodal unless pn is small. For the 
frequency of the (r + l)th term is greater than that of the rth so long as 



l^r+l ^ 


O' 


or 

or 

which is equivalent to 


(w — r — l)*(r -f 1)^ p 
(n — r)W^ ^ q 

LrLi ^ 

n — r ^ q' 


r + 1 

w j- 1 


</?• 


Hence the frequency increases until the pomt wdien (r -h 1) ^ p{ff' ^ 1) and then declines 
again. 8ome typical distributions are shown in Table 5.2. 


TABLE 52 

Teinis of the Binomial DistrihuUon 10,000 {q { for Valnes of p from 01 to 0 6. 



(Figuies given to the nearest 

unit.) 


JsTumbor of 

i? = 0 1 

p - 02 

1 

1 p — 0 3 

/) - 0 4 

p — 0 5 

Successes. 

1 - 0 9 

g = 0 8 

1 g - 0 7 

- 0 0 

g - 0 5 

0 

1210 

115 

1 8 



1 

2702 


08 

5 

— 

2 

2852 

1309 

278 

1 31 

2 

3 

1901 

2054 

710 

' 123 

11 

4 

898 

2182 

1304 

1 360 

46 

5 

319 

1740 

1 1789 

740 

148 

b 

89 

1091 

1910 

1244 

370 

7 

20 

5J5 

1643 

1059 

739 

8 

4 

222 

1144 

1 1797 

1 1201 

9 

1 

74 

054 

1597 

1602 

10 

— 

20 

1 308 

1 1171 

1 1762 

11 


5 

120 

1 710 : 

I 1602 

12 

— 

1 

39 

355 ’ 

1201 

13 

— 

— 

10 1 

! 146 

739 

14 

— 

— 

1 2 

49 

370 

16 

— 

— 


13 

148 

lb 

— 


— 

3 

40 

17 

— 

— 

— 

— 

11 

18 

19 

20 

— 

— 

— 

— 

2 

Z 1 

1 

— 

— 

— 

— 


5.7. The ordinates of the binomial are most directly calculated from the formula 
q^-i 2 )^ ; for low values of n the calculation is straightforward and for high values 
assistance can be derived from tables of log n\ The calculation of the distribution function, 
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which is equivalent to the summation of terms of the binomial, is tedious to perform directly, 
but use may be made of the tables of the incomplete ii-function. We have, for Taylor’^s 
series with the integral form of remainder 

/(« + A) = V 

Putting a — q, h — p and f(a + A) = (gr + _p)» we have 


(g -f pY = 

where is the remainder after r terms and equals 


R.-j' 


r-l 


p'(i - ty 

(r - 1 )! (»-r)! 


(g -I- ptY~'' dt 


In (5.14) put <=!—-. We find 


R, 


ri) 

.T'-» 
J II 


nl 

(r — — ^)’ 

= B (r, 

r(r)r(n - r -f 1) 

^ B„(r, n - r + 1 ) 

B{r, 71 ^ r + 1 ) 

= Ip{r, 71 - r [- 1 ) 

iu the usual notation. This is also equal to 




dx 


pV' » ^ ^ + 1) 


. (5.14) 


. (5.15) 


1 -- r + l,r) .(5.16) 

by a well-known property of the .^-function. 

The remainder after r — 1 terms is, similarly, I^{r — 1, n — r + 2 ), and hence the 
rth term is 

— l^{r, n — r 1) + /p(r — 1, /? — r -f 2) 

= lg{n — r -f 1 , r) — Iq{n — r f 2, r ~ 1 ). . , . (5.17) 


Examj)le 5.1 

When n ™ 20 , r ~ 11 , 0-4 we have for the remainder after 11 terms 7 ^ 4 ( 11 , 10 ) 

which from the tables is found to be 0 127,521,2. The value given by summing the last six 
terms in the apj)ropriate column of Table 5.2 is 0*1276, the en*or in the last place being due to 
rounding up. The remainder after 12 terms is /<, 4 ( 12 , 9) 0*056,526,4. The 11 th term 

(10 “ successes ”) is then the difference of these two remainders — 0-0710, as shown in 
Table 5.2 for the frequency per 10,000 of 11 successes. 


The Poisson Distribution 

5.8. Cases sometimes occur in which the proportion p of “ successes in the popula¬ 
tion is very small. We may suppose our number n largo enough to render np itself appreoi- 
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able though p is small; and we are thus led to consider the limiting form of the binomial 
(5.2) as p—^ 0 subject to the condition that np remains finite, and equal to A, say. 
Under these conditions the term 

(ry^ - in -r)lr\n\^ - n) 

A’’ 




(■-> 


rl 


rl 


Thus the terms of the binomial become the successive terras 


'(sv-.j;....). 


. (5.18) 


This is called the Poisson distribution, having been given first by Poisson in 1837. It 
has since been discovered independently by several other writers. 

From the point of view of characteristic functions we have 

</;(/)== lira (q pe^^y^ 


■ ]im il 4 — 1)1 

n — (, ^ 1 

= exj) — 1) 


. (5.19) 

which is readily verified to result iu the distribution (5.18). 

Thus 

Vit) = A(e« - 1) = 

and hence all cu mill ants of the Poisson distribution are ecpial to A. We thus find 

/<, = A 1 
//j — A 
//, A 

= A + SA^J 

If WO let a —>- 00 in (5.11) and (5.12) we find 

. 


. (5.20) 


and 


/h+i 


.A.,., 


(5.22) 


5.9. Tables of the function ^^ for various values of A and r are given in Tables 

for Statisticians and Biometrioians, Part I. The frequency polygons are very skew, almost 
J-shaped for low values of A, but become nearer to unimodal symmetry as A increases. 

A^ A**“* ^ 

A comparison of the successive terms and — shows that the frequency increases 
up to the point for which r + 1 < A and then decreases again. 
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The Bummation of r terms in the Poisson distribution may be carried out in a manner 
similar to that of 5.7. The remainder after r terms of the distribution is found to be, 
from (5.13) 


Br 


mi 
Pdr) 
r{r) 
A 


e»(i-0(i _ f).-i dt 




(5.23) 


in the notation of Pearson’s tables of the Incomplete i''-fuiiction. The argument used 
in these tables is a difficult one to work with in the present case and, though formula (5.23) 
may be used for summing a number of terms in the Poisson distribution, it is easier to 

calculate directly rather than to use an analogous expression to (5.17) in the form 


rth term 




V{r - 1) 


, r 




5.10. We now consider a generalisation of the binomial and the Poisson distributions. 
In 5.2 our approach was based on the drawing of sets of 7t from the same po])ulation. 
Suppose, however, we draw them from n different populations with proportions 

(Pi. 9i) (p*. ^ 2 ) . • ■ (p„, g„). 

Then our projiortional frequencies will be arra^^ed by the form 


(Pi + ?i)(P 2 + ga) • • • {Pn + ?n) = ^ iP^ + 9j) 




(5.24) 


which of course reduces to the binomial if all the p’s are equal. 
The characteristic function of this distribution is 


from which we have 


== n(q^ f- 

y}(t) Z: log -{- p/^0 


=^riog| 


1 + pjit + 4 - 


■} 


{it)Epj + -^J-i:(Pj 


Pj^) 4-, etc., 


givmg 


-Pj 


ftz -= ^Pj^j) 

Writing now p for the mean of the p’s in the different populations, we have 

/(\ = np 

//j = Zpq = Ep ~ Zp^ 


(.5.25) 


= - ^(2»* 
= np — np^ 


>■} 


n var p 


(where varp is written for the variance of p) 

= nfq — n var p 


. (5.26) 
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A comparison of these results with those for the binomial shows that the variance 
of the distribution (5.24) is less than that of the binomial with the same average p by an 
amount equal to n times the variance of p. 

Similarly we see that, for the Poisson distribution in such a case 

= X, the mean of the X^s .... (5.27) 

and y/g ^ A ~ i var {np) 

— X to order 

The Poisson form thus holds for (5.24) notwithstanding the inequality of the ^’b, provided 
that the variance of X is small compared with n, which will be so if all the p's are small. 

5.11. Consider now the case when successive sets of n are drawn from different popula¬ 
tions characterised by pi, P 2 • • * Pic previous case we supposed any set of n obtained 

by taking one from each of ri populations. 

We now suppose that any set is drawn from one population only, but that different 
sets come from different populations. Our array of frequencies will now be 

1 ^ 

i Pj)” .(5-28) 

J 1 

and evidently the moments of this array are the sums of the moments of the (q + p)^, 
that is to say, from (5 4), 

1 V 

//, ^ Ivp 

/i 2 ^ 1 In(n - l)7>2j. 

Writing p for the iiK^an of the p'a as before, wo have 

//j =^vp 

y/g 71 p -{- riErtipi — \)p^ — n^p- 
iC 

-= npq -f- ^2n(?A — - n{n ~ l)/7- 

=- )ipq H v{n - 

npq -f 7i{ii — 1) var^;. ..... (5.29) 

In this case the variance is greater than what it would bo if the distribution were of the 
ordinary binomial type by an amount 7 ?(re- J)varjp. 

For the Poisson distribution we have, on taking limits, 

5 , 3 I.(5.30) 

//a = A + var AJ ' 

and here also the variance of the distribution is affected. 

5.12. The results of the two preceding sections enable us to discuss the occurrence 
of the binomial and the Poisson distributions in practice. An example has already been 
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givem in Table 5.1 of a distribution conforming to the simple bincnnial type. It is not 
easy to find material compiled outside the laboratory which does so. 

For example, suppose we regard the possession of blue eyes as a success, and take 
a number of samples of n from the population of the United Kingdom in different localities. 
We should probably find that the proportions in these samples did not conform to the 
simple binomial form. The variance rtpq calculated from the known n and observed p would 
probably turn out to be too small. If so we should conclude from (5.2()) that the proportion 
p varied from place to place in the population, the deficiency in the variance of the propor¬ 
tions observed being due to the variance of p itself in the sections of the population from 
which the samples were chosen. We are assuming for the time being that these differences 
are not explicable on the basis of sampling fluctuation alone ; but a full discussion will 
have to wait until later chapters, 

5.13. The same effect is found in distributions which at first sight might be expected 
to be of the Poisson type. For example, suicide is a rare event and it might be supposed 
that if we took a series of large samples, say the population of the United Kingdom in 
successive years, the frequencies of suicides would follow the Poisson distribution. This, 
however, is not necessarily so, for all members of the population are not equally exposed 
to risk and the temptation to suicide may vaiy from year to year, e.g. being greater in 
years of trade depression. This inequality of risk is typical of one field in which the Poisson 
distribution has been freely applied, namely, industrial accidents. Table 5.3 shows, in 
the second column, the frequency of accidents occurring to women working on the manu¬ 
facture of shells. The Poisson frequencies shown in the third column provide a very 
poor fit. Tlie reason is that the liability of individuals to accident varie^s. 


TABLE 5.3 


Accidents to 647 women working on H.E. shells 5 weeks. 
(Greenwood and Yule (1920), J. Roy. Statist. Soc., 83, 255.) 


Number of 

Observed 

Poisson Distribution 

Distribution given 

Accidents. 

Fioqnoncy. 

with same Mean. 

by (5.33). 

0 

447 

406 

442 

1 

]32 

189 

140 

2 

42 

45 

45 

3 

21 

7 

14 

4 

3 

1 

5 

5 

2 

{ 

{ ^ 

Totals 

(>47 

648 

648 


As a working hypothesis (cf. Greenwood and Yule, 1920) suppose that the population 
is composed of individuals with different degrees of accident proneness, represented by 
different values of A in a Poisson distribution ; and suppose that in the population the 
distribution of A is given by 

dF =d?. 0<A<oo, . . . (5.31) 

r(p) 

There are theoretical reasons justifying this supposition. 
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The frequency of j suecesses is then 


Jol{p) 


or the coefficient of t*" in 


pP /•« 

1 6“'’^ A"" * e“^+^ dk, 

I(P)Jo 

which, on the substitution of (c + 1 — t)X = u, becomes 

(c~-ri - <7" " VcTV V ~ Tflj 

The frequency of 0, 1, 2, . . . successes is therefore 

/ c Y'Ij p i>(P+T) 1 

\c + lj \' c + 1’ 2!{f + 1)2 • • 7 


The mean is thus 


^' Vc -f 1/ V +1 -f j 

/ c \p p /c -f ^ 

\c + 1/ > i- 1 \ c ) 


V 

c 


iSimilarly 


' =- so that 


p(c + 1) _ p 


(5.32) 


(5.33) 


r* 2 


(5.34) 


(5.35) 


If we now put the ol^served rrieaTi and variance of Table 5.3 equal to the values of (5.34) 
and (5 35) we have two equations w^hich can be solved for p and r. The distribution (5.33) 
can then be found. The frequencies are given in the fourth column of Table 5.3 and evidently 
give a much bettor agreement with the facts. 


5.14. The interesting feature of the distribution (5.32) is that it is a binomial with 
negative index. In the approach adopted in 5.2 the index is necessarily positive ; but it 
is often found that observational materials are represented by negatively indexed binomials. 
Yule (1910) ♦ has given an illustration of this effect which does not depend on any arbitrary 
assumption about distributions such as that embodied in (5.31). Suppose, in fact, that 
we have a population subjected to recurring attacks of a disease, that r attacks are fatal 
and that on the average one attack is fatal to a proportion p of individuals at risk, the 
actual numbers succumbing varying as if the population were chosen at random from a 
larger population in which the proportion of survivors is p. Consider the proportion of 
individuals surviving 0, 1, . . . attacks at the wth exposure. Evidently this is the propor¬ 
tion of successes in samples of n when the chance of success is p, i.e. (q 4* p)^. The proportion 
of survivors at the end of n exposures will be the sum of the first r terms in this series. 


* J, Roy. Statist Soc., 73 , 26 . 
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The proportion of survivors at the end of (n — 1) exposures will be the sum of the first 
r terms in (q + Consequently the proportion dying during the nth exposure is 

the difference. 


- zjc 7 + G -” c 7 y-y 

=|:{G::>"-'^-C7>-'-'^'"} 

- G ” iV"'"- 

Thus, since death does not commence till the rth exposure, for the values of « from 
r onwards we have the proportion of deaths 


i.e. successive terms in p’‘(l — q)^^, a binomial with negative index. A law of this kind 
has been found to operate in experiments on fbe killing of bacteria by disinfectants. 


The Hypergeomdric Distribution 


5.15. Consider now the generalisation of the approach of 5.2 when samples of n are 
drawn from a population of N individuals, where N is not necessarily large. Tf we take 
a sample which contains r P’s, and n — r Q’s, it can arise in 


/n\Np(Np — 1) . . . (Np — r -|- l)Nq{Nq — 1) . . . (Nq — n + r — \) 
\r) ‘ NiN ™ 1) .T : (A - /^ -f 1) 

fn\(Npy^\Nqy^"^^ 

JSfCn]- ~ .... 


O' 


. (5.37) 


ways. For there are 


’ 0 ) 


ways of selecting the sample, and the r P’s can be chosen in 


ways, and the 7i ~~ r Q's in ways, the expression given in (5.37) being 

e,!. - (?) (,?.)/(?. 

Hence we are led to consider the discontinuous distribution 

^ . (6.38) 

a form in ’which the analogy with the binomial (5.1) is evident. As A —oo the form 
(5.38) approaches the binomial. 
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The series 


is equal to 




{Nq)^ 2 ’ 


NM —71+ j)l»l j ! 

that is to say, to the hypergeometric function 

^IwJ ^ P y yy 

if a= — n, /?= — Np, y = Nq — 71 ^ 1. 

The distribution (5.38) is therefore called hypergeometric. We have 


F((x., p ; 7, a:) = 1 


ir a(a -f 1)P{P + 1) , 

y 1! y(y f 1) 2» 


and it is well known that this function satisfies the differential equation 

■*^(1 - + (y - (a + /? + l)xf£ - ^fiF =0, . . (5.41) 

a fact which may be readily verified from the equation itself. 

If in (5,39) we put x = {0 ~ it) we evidently have tiie characteristic function of 

the distribution. On making this substitution in (5.41) we find, after some reduction and 
replacement of the values of a, /?, y by those of (5.40), 

(1 - I + nNp<f>'^ - Nnp4, + 0 . . (5.42) 


fuL 0^ 

Since <f) — ^ ~jr from the coefficient of 0^ in this expression, 

— Nnp -f- Nj!j\ = 0 

np . . . . . . (5.43) 

the same result as for the binomial. The mean of the hypergeometric series is independent 
of N. 

Taking now the distribution about its mean, and hence substituting for </} in 

(5.42), we find 

~ - ?) - ^P] +{N - n)pqr><f>'^ + iV|| = 0 . (5.44) 

whence, identifying coefficients in 0, 0^, 0* we find 

npq(N — n) ,r ak\ 

^ _ j.(5-45) 

_ npq{q - p){N - M)(iV ~ 2n) 

- - (iV - 1)(N - 2) . 

+ +6«(N-«)}] (5.47) 


. (5.46) 


and generally, if F denotes the operation of raising the order of a moment by unity, i.e. 
EjUy =- we have 

^Mr+I = {(1 + Ey - F'}[/iit-{Np +• n{q - p)}fti + {npq(N — »),««}] . (6.48) 

As we expect, when N oo these values tend to those of the binomial. 
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6.16. An es:ample of the occurrenoe of the hypergeometric series in practice is given 
in Table 6.4, giving the frequency of occurrence of cards of a certain suit in hands of whist. 
Here N is the number of cards in the pack, 52, and n = 13, p = J. The appropriate 
series is thus 

giving tlie frequencies shown in the third column. This agreement appears to be reasonably 
good. 


TABLE 6.4 

Distribution of 3400 First Hands at Whisi according to Number of Trumps in the Hand. 
(K. Pearson, 1924, Biometrika, 16, 172.) 


' 

Number of 
Cards in 
tho Hand, 

Observed 

Frequency. 

Frequency of 

H y pergeometrio 
Distribution. 

Number of 
Cards in 
the Hand, 

Observed 

Frequency. 

Frequency of 
Hypergeomotric 
Distribution. 

0 

35 

43 6 

6 

444 

4240 

1 

280 

272-2 

(> 

115 

141 3 

2 

696 

700-0 

7 

21 

30-0 

3 

, 937 

973-5 

8 

11 

1 4-0 

4 

851 

' 811-3 

9 and over 

1 

0 

1 

! 0-2 



1 

■ i 

Totaus I 

i i 

3400 j 

1 

3400 


5.17. The calculation of frequencies and the summing of series of frequencies is not 
so simple^ a matter as for the binomial, but the incom})lete ^-function may be used to 
give a fairly good approximation. The method consists of fitting a B-curve of type 

dF ™ (1 — xy*-^ dx 0 <x c 1 

Bip.q) 

to the distribution and obtaining areas of that curve from the /^-tables. Details of the 
method and an example are given in the preface to the Tables of the tiicoraplete B-function. 


The Normal Distribution 


5.18. We have already noted in Examples 4.0 and 4.8 that the binomial distribution 
and the Poisson distribution both tend, when expressed in standard measure, to the form 

1 

dF = dx — 00 < a; < 00 . . . (5.49) 


The slightly more general form 

dF = e ^ ^ dx — 00 < < 00 . . (5.50) 

V 2710 


is known as the normal distribution. It is the most important theoretical distribution in 
statistics. The expression (5.49) is of course the normal distribution in standard measure. 
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We have for the characteristic function of (5.50) 



II 

. (5.51) 

giving 

1 . . 

. (5.52) 




and 

= . . . 

. (6.53) 

so that 

Ki = /4i = 1 

AT,. - 0, r > 2J 

. (6.54) 


We also have = 3, y* = 0, which accounts for the standard adopted for mosokurtosis 
in 3.32. 


5.19. The distribution function of the normal distribution evpressed in standard 
measure is tlie integral 

. 

The integrand may be expanded and we have 

1 


F{.r) 



vT* 

e~ 2 dx 

%/(27r) J 

0 

1 

I'ji 

\ (2^) . 


1 / .r2 

V^(2^)V “ 2 T 3 


dx 


1 

2 » 22.5 


ete.^ 


This converges too slowly to be of use for other than small values of x. 
If X is laige an asymptotic series may be employed. We have 


_ I* 

1 C'e~ixclx 
v/(27r)J, 

(2;i)L X J, 


V(2^) 

and on repeating the partial integration, 


\/(27r) J, 


e 

V{27t 


O'* 

27i)x L 


X^ X* 


3.5 


. . . ^ 7?^ 




where is less in absolute value than the last term taken into account. 


(5.5G) 


(5.57) 


The most useful forrpula, however, is a continued fraction due to Laplace. Put 

3 


«(/) 


-i-/]__ + 

1 - t\ a;*(l - <)* 


x*(l - <)‘ 


A.S. 
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so that a(0) is the expression in curly brackets in (5.57). We then have 

1 aa _ 1 3 

dt x^(i -lY ‘ * 

- {(1 ~- 0 a (^) - 1 } 

Hence if a(f) = we have, identifying coefficients in 

1 


Hence 


(r -f l)2/r4l + Vr “ Vr l = 


] 


1 -u r r^iJ 

X^ ?/r 


Thus 


yi 

X X 

2 i ,?/* 

^0 


■r + y» 


xy^ 



_ .r 2 3 

11 


X -f- X H- X 4* 

■ ■ ■ 1 


(5.68) 


Now when ^ = 0, a reduces to and we also see from (5.58) that as x —> co, yi == ?/o. Hence 
we have, from (5.57), 


1 - F{x) 


e 2 


1 


\/{2n)x \x f X 4- .r + 


1 

V^(2^ 


4-1- J 

U -1- .T 4 .r -f 


(5.59) 


The continued fraction thus gives the ratio of the fre(|nency of the normal distribution 
to the right of the point x (the tail area '') to the ordinate of the frequency-distribution 
at that point. 

This expression was in fact used by Sheppard (1939, posthiimous) in calculating his 
superb tables of tlie normal function. These tables give, among other things: — 

(a) The ratio of the tail area to tlu' bounding ordinate, to 12 places of decimals, for 
intervals O-Ol. 

(h) The same to 24 places for intervals 01. 

(c) The negative natural logarithm of the tail area, to sixteen places, by intervals 01. 

Tables which are sufficient for all ordinary purposes will bo found in Tables for Statisticians 
ami BionietricianSy I’arts I and II. At the end of this volume we give some tables which 
will suffice to illustrate the theory and examples given herein. 


5.20, The shape of the normal curve 


y = 


1 

vW) 


2 


is illustrated in Pig. 5.1. It is symmetrical and unlimited in range, falling off to zero 
very rapidly as the variate increases. There are points of inflection at unit distance on 
either side of the mean. 
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For the mean deviation we have 

V27r J. 


X e 


/2 r* 

= V;J.." * 


dx 


0*79788 


(5.60) 


The variance is of course unity, because the distribution is expressed in standard measure. 
The quartiles are distant 0*674,489,75 from the mean, as may be found from the Tables, 


04 



Fit. ~i I Tlio Normal C*ui\c y - 


5.21. As an illustration of the occurrence in practice of a distribution which is very 
close to the normal, the height data of Table 1.7 may be taken. Table 5.5 shows the 
actual frequencies and those given by the normal curve with the same mean and standard 
deviation (67*46 and 2*56 inches respectively). 

The correspondence is evidently fairly good. It must, however, be noted that whereas 
the theoretical distribution has infinite range, the practical distribution has not, since it 
is impossible to have a negative height. In this particular ease the relative frequency 
of the normal distribution outside the range 57-77 inches is so small that the point is 
unimportant; but when distributions of finite range are represented by those of infinite 
range it is as well to remember that the fit near the tails may not be very close. 

5.22. The normal distribution has had a curious history. It was first discovered 
by De Moivre in 1753 as the limiting form of the binomial, but was apparently forgotten 
and rediscovered later in the eighteenth century by workers engaged in investigating the 
theory of probability and the theory of errors. The discovery tliat errors of observation 




132 


STANDARD DISTRIBUTIONS 
TABLE 5.5 


Freqmncy*Distribution of 8585 Men according to Height {Table 1.7) compared with Theoretical 
Frequencies of a Normal Distribution with the Same Mean and Variance. 


Height 

Observed 

Theoretical 

Height 

Observed 

Theoretical 

(inches). 

Frequency, 

Frequency. 

(inches). 

Frequency. 

Frequency. 

57- 

2 

1 

68 

1230 

1234 

58- 

4 

3 

69- 

1063 

989 

59- 

14 

11 

70- 

646 

682 

60- 

41 

33 

71 - 

392 

405 

61- 

83 

88 

72- 

202 

207 

62- 

169 

I 200 

73- 

79 

91 

63- 

394 

395 

74- 1 

32 1 

1 34 

64- 

669 

! 669 

75- 

1 16 

' 11 1 

65- 

990 

976 

76- 

1 ^ ' 

i 3 

66 - 

1223 

1227 

77- 

2 ! 

1 

67- 

1329 

1326 

Totm^ 

8585 

_1 

1 

8586 j 


ought, on certain plausible hypotheses, to be distributed normally led to a general belief 
that they were so distributed. The belief extended itself to distributions such as those 
of height, in which the variate-value of an individual may bo regarded as the cumulation 
of a large number of small effects. Vestiges of this dogma are still found in textbooks. 

It was found in the latter half of the nineteenth century that the frequency-distributions 
occurring in practice are rarely of the normal type and it seemed that the normal distri¬ 
bution was due to bo discarded as a representation of natural phenomena. But as the 
importance of the distribution declined in the observational sphere it grew in the theoretical, 
particularly in the theory of sampling. It is in fact found that many of the distributions 
arising in that theory are either normal or sufficiently close to normality to permit satis- 
fact^ory approximations by the use of the normal distribution. Furthermore, by a fortunate 
accident (if one may speak of accidents in mathematics) it happens that the analytic form 
of the normal distribution is particularly well adapted to the requirements of sampling 
theory. For these and other reasons which will be amply illustrated in the sequel, the 
normal distribution is pre-eminent among the distributions of statistical theory. 


5.23. Since the normal distribution may be considered as the limit of the binomial 
it is natural to inquire into the limiting forms, if any, of the hypcrgeometric distribution. 
From (5.38) we see that the difference between two successive terms in the distribution is 


1 n\ 

V\(n — r ~ 
I nl 

JV'lw] 


1 )! 


(Npy''^Nqy^-^-^l 




Nq 


n 


(Npy’-^Nqy^ 




I r + 1 
— Nq n 


1 


(r 'f- l){Nq — n 
The ratio of this differeiKic to the (r l)th term is then 

Apr A 4- Br 


_ 

n ~ r 

■ r(N + 2) 
- r) 




'}■ 
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where the quantities A E are constants. In the limit when the distribution is 

expressed in standard measure, is the increment when r increases by a small quantity, 
and we are thus led to consider the differential equation defining a frequency function 


^ ^ tj®*’ _ dx 

f C + Dx + Ex^ ■ 


. (6.61) 


This is the equation of a family of functions—the Pearson distributions—which will be 
considered from a slightly different standpoint in the next chapter. 


The Bivariate Binomial Distribution 

5.24. In generalisation of the results of 5.2, consider the drawing of samples of n 
from a population the individuals of which may or may not have two attributes, P and 
not^P (= Q) and B and not*P {= S), Suppose that the proportions of the individuals 
With attributes PB, QB, PS and QS are a, b, c and d respectively, where a + b |-c 4 -d = l. 
Tn exactly the same way as for the binomial case it is seen that the proportion of samples 

tit 

with t PP's j QB'b, 1c PS'b and I QS'a is a%^c^(P and the distribution of samples is 

given by the multinomial form 

/=.(a + 6+ c f d)^ .(5.62) 

The distribution given by this form is bivariate, one variate being the number of P’s and 
the other the number of R's, The characteristic function of the distribution is 

^ -f- f I df .(5.63) 

We have then 

’ log (/, = logjrt -j b \-c -t d ( ai(/i f- /j) + hitt + r»7, — "(/, h — if + ■ • -j 

==Iog|l 1 i{a h)fi >r i(a i c)(i • (6.04) 

Fiorn this it is seen that the mean of the variate corresponding to the occurrence of P’s 
is n((f + c), and that of the variate corresponding to the occurrence of the P’s, ?{{a H- b). 
From the terms in and t?j, in the expansion of (5.64) we find also that the variances are 
7 i{a 1 - c)(l - a r) and n(a + 5)(1 a ^ 6). If we now transfer the origin to the mean 
of the variates w(» liave 

log r- » ^ -I c)(l — a 4- c) 4 fj(a -f b)(\ ~ a b) { a ^ ca -i b)} } 0 {n), 


Thus when the distribution is expressed in standard measure and n allowed to tend 
to infinity the characteristic function tends to the form 

log ( 5 ^^ = — \{(\ 4* t\ + • • • (5.65) 

where p = - - ^ ^ — _ 

{{a 4- €)(l — a 4 c)(a -}- 6)(1 -- a + 6)}* 

This, as was seen in Example 3.15, is the characteristic function of the bivariate form 


dF = I exp I -- - -1(.rf - - 4- .t|)\ d.i\ dx^ - co < < oo (5.66) 

Zn[l — [ 2(1— p4 J 

Thus the multinomial form (5.62) tends to the form (5.66), which may be regarded as the 
bivariate analogue of the normal distribution. 
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If the two attributes P and R are independent in the population, that is to say, the 
proportion of P’s among P’s is the same as among the not-P’s, we have 

a c 

a + 6 c d 

and hence 


^ 4“ f- r 

a ^ b c d a b I 


so that a — {a b){a c) — 0. Thus p in equation (5.65) vanishes. In this case and 
only in this ease the distribution (5.66) becomes 


dF =r 


e- dw. 


, ^ e dx, - - ^ - 
\/(27t) \/(27 t) 

i.e. u’l and Xz are independent variables. This is what we should expect and, indeed, is 
necessary if our use of the word “ independent” in relation to attributes and frequency- 
distributions is to be consistent. 
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EXERCISES 

5.1. Show that for the binomial distribution {q -|- p)“ 

(Ik. , 

, r>l. 

Hence, writing c = U'pq, ^ <1 ~ IK — 

/Cj =r= c ; /Cg = eg ; ~ c ; icg — ^ (r — 12c2) ; kq = c ~ 30c^ 4* 120c^; 

K, = 6^ (c 60c2 4 360c3) ; =:= r ~ 126c2 IGSOc^ - 5040c4 

(Cf. Haldane (1939), who gives formulae up to ki^.) 


5.2. Show that for the inwmplefe moments about the mean of the binomial 

n 

^ U - npr^piq^-( 

j ft \^ / 

equation (5.12) holds, i.e. 

(Romano vsky, 1925.) 


5.3. 


Writing 



are given by 


/^o == 


>» 



j-p 


show tliat the incomplete moments of the binomial 


/I I -= pq7\ 

f'i -= {p - (// I- ] )p} i npq/io 

Pi—pqTXip - (»' 1 1 7^<1 - 1 ) i npq (q p) /'«], 


and geneially 


Pr -= pflT,(p ~ np)' ' 


npq 





(Friseli, 1926. This is the gemu*alisation of equation (5.11) to ineomplete moments.) 


5.4. Show that about the origin of the hypergeometrif* distribution 


5.5. From equation (5.48) derive the recurrence formula for the moments of the binomial 
{(1 4 - Ey — E'}(npqp.o — pp,) = p,^i 
and that for the Poisson distribution 

{(1 -f Er - ,, 


(K. Pearson, 1924.) 



136 


STANDARD DISTRIBUTIONS 


5.6. Show that if y 




e 


j: 


(lx = 


2a\/7t 

Hence, if a normal distribution is grouped in intervals with total frequency and Nt is 
the sum of the squares of frequencies, an estimate of o is 


_Nl 


0*282,095 


Nl 

NV 


For the height data of Table 1.7 show that this gives an estimate of a equal to 2*553, an 
error of about I per cent. 

(Yule (1938), Biometrika, 30, 1 .) 


5.7. If a distribution of type (5.24) is represented approximately by a binomial 
{Q + Py, show that 


vP = nf 

vPQ = npq — n var p 

so that P = p -\~ and hence is positive ; consequentJy that v is positive. 

If, however, the distribution is of type (5.28), then 


P p ^ ^ 

so that P, and hence v, may be negative. 


(“Student/’ 1919.) 


5.8. The bivariate Poisson series. Show that when a, h and r in e(piation (5.62) 

are small but 7ia{~ A 3 ), n/>(— Ai ” Ag) and Ajj - Ag) are finite, the distribution tends 

to the form whose general term is 

A 3 MA 1 A3)^(A2 A;,)^* 

i^j\k^ 

5.9. Show that if the frequencies of two symmetrical binomial forms of degree n 
are superposed so that the rth term of one is added to the (r -f 1 ) term of the other, the 
resultant frequencies are those of a symmetrical binomial of degree {n 1 ). Deduce that 
if two normal distributions with tlie same variance and means differing by a small part 
of the variance are added together, the resultant distribution is nearly normal. 
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STANDARD DISTRIBUTIONS—(2) 

6.1. In this chapter we continue the account, begun in the last, of the standard 
distributions of statistical theory. From the variety of forms assumed by the frequency- 
distributions of experience, as exemplified in Chapter 1, it is evident that an elastic system 
would be required to describe them all in mathematical terms. Three approaches will 
be considered herein : the first, due to Karl Pearson, seeks to ascertain a family of curves 
which will satisfactorily represent practical distributions ; the second, due to Bruns, Gram 
and Charlier, seeks to represent a given frequency function as a series of derivatives of 
the normal frequency function ; the third, duo to Edgeworth, seeks for a tian&formation 
of the variate which will throw the distribution at least approximately into the normal form. 


Fea r-so/? Distribitiioa *s 

6.2. It was noted in 5.23 that in the limiting case the hy]>ergeometrie series can 
be (expressed in tlie form 

‘if _ (•<■ -")/ 

(lx />o I i 


( 6 . 1 ) 


This equation may be considered from a slightly different standj)oint. Tlie unimodal 
distributions of Cliapter 1 suggest that it might be wwth while examining the class of 

7 -P 

frequency functions wliich (a) have a single mode, so tliat vanishes at some point x ~ a ; 

/ P 

(b) have smooth contact with the r-axis at the extremities, so that /- vanishes when f 

ax 


0 . 


Evidently these conditions are in general obeyed bj^ any distribution of the family ( 6 . 1 ). 
In actual fact, as will be seen below, there are also solutions of ( 6 . 1 ) in particular cases 
which are J- or U-shaped. 

The family of frequency functions defined by ( 6 . 1 ) are known as i^earson distributions. 
Before obtaining explicit solutions of tlie equation, we consider certain general results 
which are true of all members of the system. We have immediately 

{bo -f byv F b^x^)(lf {x ~ a)Jdx 


or 


F'ibo -h b^x -1 b^x'^) dx — x^(x 


a)fdx. 


Integrating the left-hand side by parts over the range of the distribution, we find, assuming 
that the integrals exist. 


j^a;"( 6 o -f- biX + />2^®)/J ^ | ^ -f -I l)biX'^ + (v -f 2)^2^’*^^}/^/^- 

^QO /.CO 

' = I x^'^^fdx — erj x'^f(lx . 

J - oo J oo 

Let us assume that the expression in square brackets vanishes at the extremities of the 
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( 6 . 2 ) 
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distribution, i.e. that lim if the range is infinite. We then have, sub- 

stituting momenta for integrala in ( 6 . 2 ) 

— '»bo/^‘n-l — (« t- 1)^1/';, — (« I '^yhfln + l = /“n + 1 ^ “/4 

or -I- {(« -I ^)lh — + {(« -t 2 ) 6 , f 1 }/4h i • • (6-3) 

This equation permits of the dett*rmination of any moment from tliose of lower orders. 
In fact, all moments can b(i expressed in terms of a, bi and b^ and the moments /io(= 1) 

and /j.\. Conversely wc can express these four constants in terms of the moments f/\ to 
or the three moments about the mean fio to /Z 4 . Putting ~ 0 , 1 , 2 , .3, successively in 
(6.3), we find t^quations for or, 60 , ^ 1 , 62 which result in 


bo 

b, 

h. 


+ 3yu|) 

A 

/Z2(4//2//4 “ 3/z|) 

A 

/^3(/^4 f 3/z|) 

A 

( 2 /Z 2 /Z 4 — 3/4 — 6/4) ^ (2/9a — 3/9, -- 6) 

A " A' 


~ A'^ 

3j0,) 

~ A' 

f 3) 
A' 


. (6.4) 


(6.5) 


where A ~ l(V^ 4/^2 — 1^/^al 

A' - 10^2 ~ - 13/?i 

It follows that a curve of the family ( 6 . 1 ) is completely determined by its first four 
moments, //\ to //,. 


6.3. In equation ( 6 . 1 ) the mode is evidently at the point .v — a. We have then 
for the Pearson n^easure of skewness (3.31) 

~ a y'4- 3) 


Sk = 

V >2 10/92 “ 12(^1 - 1 « 

the form given in 3.31. 

Further, if we take an origin at the mode so that a ~ 0 we find 

^ t =- Ul ~Ij )x^ a 

dx^ dx 5o + biX [ b 2 X^ (6u -j- biX -j- b 2 X^)^ ^ 

Thii.s any points of infl(‘ction in the frequency curve are given ]>y 

62 - 1 ' 


( 6 . 6 ) 


(6.7) 


( 6 . 8 ) 


Hence there cannot be more than two of them, and if they exist, they are equidistant from 
the mode. It is not to be inferred that a curve of the family cannot have a single point 
of infl(H*tion, for one point corresponding to the solution of ( 6 . 8 ) may be outside the per¬ 
missible range of .r. 


6.4. By a simple transformation of the origin to the mode, ( 6 . 1 ) may be written 
dx ^ Bo 4- ~a)l~ B 2 {x~-- a)^ 

dX ^ B„ + BX + jB.X“ 


or 


(6.9) 
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The explicit expression of the frequency function / is thui^ a matter of integrating the right- 
hand side of (0.9). 

Following Pearson, we may distinguish three main t 5 rpes according as the* denominator 
on the right in (6,9) has real roots of opposite sign, real roots of the same sign, or imaginary 
roots. Pearson also distinguished ten other types, some entirely trivial, when the B'b 
take particular values.* 

Type T 

6.5. Let 


Then 


B, + B,X i- + aO(X -- a*), 

dX "" B^{X + a.)(.Y - aO 


ai, ag ^ 0 


_ aj ^ 4 _ ^^2 1 

4- aj)’(-^ +■ ai) -^sCai + aj)'(X — a,) 

__ _at_ 

giving f = k(X - a, 

This is g(Mier,illy written in the form 




( 6 . 10 ) 
(6 11 ) 


where 


__ m 2 
a I Hi 

Tlu' range of the curve is from to a 2 . and })y integrating bet ween these values we find 
1 


-.jS' (\ f--^-Y"Yi -‘"‘YV, 

J-t/A aj \ (H) 


which, on putting .r (</i t rig)// - reduces to 


1 - Z' 


'■[ y" 

J 0 


■(1 -?/)"''. 


(aI 


A-(ce, 4 - a,)"'.*'". 


B(mj f 1, J- 1). 


Tliis (leterniines k and we hav(» 


/- 




(". 4 a2)"‘*+™'‘^^ B(tni + 1, + I 


:T- ■<»-> 


Th(* origin here is the mode. Taking an origin at the start of the curve have 


f = * X’' 

(fii + ^ B(7nj^ f- 1 , ma 1 ) 

or again, measuring in units (Ui -f- a 2 ) times the original, 

1 


i'-'-y 


f = — u:)” 

/i(mi + 1 , Wa 4 - 1 ) 


. (6.13) 


6 .6. In these expressions the a’s are necessarily positive, but the m’s may liave any 
value not less than — 1. They cannot be less because the distribution function of (6.12) 
or (6.13) would not then converge. 

* The numbering of the types followed herein is that of Eiderton (1938). Some variations occur in 
earlier literature and the reader must not be surprised to find the normal curve referred to occasionally 
as Type VII. 
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If wii, m* > 0 the distribution is evidently unimodal and zero at its extremities. If 
one of the m’s is between 0 and 1 the corresponding terminal frequency is still zero, but 

the frequency curve makes a sharp angle with the or-axis, for is not zero at the terminal. 

If one and only one m is less than zero the curve has an infinite ordinate and is thus 
J-shaped. If both w/s are less than zero the curve is U-shaped. 

The condition that 4 B^X | B^X^ shall have real roots of opposite sign is that 
/io and JSa are of o]jposite sign, which is equivalent to 

B- 

— ^ < 0 
^B,B, 

or, in terms of and /? 2 , from (6.4), 

/3i(A + 3)* - < 0. . . . . (6.14) 

4 ( 2 ; 3 , - Zp, - 6 )( 4 ) 5 , - Zp,) ^ ^ ’ 

The quantity on the left w^as denoted by Pearson by the letter k and provides a criterion 
which will occur again bolOw. 

The frequency function of the Type I curve is calculable directly from its equation. 
The distribution function, as may be seen from (6.13), is expressible in terms of incomplete 
^-functions. 


Type VI 

6.7. If the roots of Bq -f- B^X -f B^X"^ are real and of the same sign it is easy to see, 
in the manner of the })recoding sections, that the frequency functions may be wTitten in 
the form 

/= - a)"’ where ( 7 i > - 1 . (6.15) 

J5(gi - (h - 1. (h + A) 

’where the range lies from a to oo if c/ is positive and from — co to ifis negative. By 

the simple transformation y = - this reduces to the Type T form (6.13), 

It will readily be verified that if :> 0 the curves are unimodal with zero frequencies 
at the terminals, if < 0 the start is J-shaped and the distribution firlls aw'ay to zero 
at infinity. The distribution function may be expressed in terms of incomplete i?-functions, 
and in this case the quantity k of (6,14) is greater than unity. 

Type IV 

6 .8. If the roots of Bq -j- BiX -f B 2 X^ are imaginary we have 


(log/) 


bMx 


B, 4Bi 


giving 


7i;{(X-f y)2 ^ 

log/ = log t log {(X + y)2 + 6*) ~ tan-i — 


/ 1*{(X 4 y)2 -i (5®}2 b. exp 




(6.16) 
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This is Pearson’s T^pe IV and is usually written in the form 

/ = ^(l + “. 

The distribution has unlimited range in both directions, tends to zero at infinity and is 
unimodal. I’he calculation of its ordinates may be assisted by some tables by Comrie 
(1939). The distribution function has to be found either by quadratures from the frequency 
function or by the use of some tabulated integrals given in Tables for Statisticians and 
Biometriciansy Part I. For instance, for the constant k in (6.17) wo have 


1 

k 


jr 

~ 0 do 

2 


= aF(2m ~ 2, v) in Pearson’s nofation. 

Tn this case the quantity k of (6.14) lies between 0 and 1 . 

The above are the three main types in the Pearsonian system. The remaining types 
are described briefly below. A number of results which the readt r can easily verify for 
himself are given without proof. 


The Normal Distribution 

6.9, If, in equation (6.9), a =- Bi =- B 2 ~ 0 , we have 

^^Oog/) = ^ 

log/- +log 

Tf this frequency function is to have a convergent distribution function, must be negative, 
= say, and we get the familiar form 

1 

/ = —— 00 ^ X < CIO, 

•' or\/( 27 t) 

Thus the normal distribution itself is one of Pearson’vS types. 


Type II 

6.10. If in equation (6*9) Bi == 0 and B 2 , Bo are of opposite' signs, the distribution, 
a particular case of Type I, becomes of the character 

0/1 -a<x<a . . . (6.18) 

(u here being different from the a of (6.9) ). 

In this case the criterion k of equation (6.14) is zero. The distribution is symmetrical 
about the origin and ranges from a to + u. If tw > 0 it is unimodal with contact at 
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the terminals of the range ; if m < 0 it is IJ-shaped. If m ~ 0 the distribution becomes 

/- 2 I’ .(6.19) 

the so-called “ rectangular ’’ distribution. 

Type VII 

6.11. If in (6.9) = 0 and B 2 , Bq are of the same sign, we find 

= + ■ ■(«<•) 

The range is now unlimited in both directions. Here also tlie criterion k of (6.14) vanishes, 
but the difference between this case and that of Type II lies in the fact that here > 3, 
whereas in the Type II case < 3. 


Type III 

6.12, If in (0.9) Bj, — 0 we obtain the distribution 

■' aei’IXp + 1 )\^ ■ K ) 

this being the form with the origin at the mode. The curve is unlimited in one direction 
(positive or negative as ^ is positive or negative). It is unimodal if j) 0, J-shaped if 

p - 0. The condition B^ == 0, from (6.4), is equivalent to 2^^ ~ 3/?i 6 — 0, 1 e k of 

(6.14) 18 infinite. 


Type V 

6.13. If the roots of B^^ -f B^X |- B^X^ are equal, i.e k - 1, we arrive at the dis¬ 
tribution 

f iJ" "C 7 0 ' r * 00 . . . (6.22) 

Hp 1) 

which ranges from 0 to 00 and is unimodal. 


Tyjjes VIII, IX, X, XI avd XII 

6.14. The remaining types are of a more special character still. 


If in (6.9) /?„ — 0, Bx " t> we have 

ryv. rni ■ s-\, “(i +;) 

If /i« ™ 0, Bx <■ ^ 0 we have 

/TT y m \ If 

T„, IX : y , ^ . 

If jG?o “ 7^2 — 0 we have 

1 “ £ 

Type X . f -- e 9 

If /7o ~ Bi =7 0 we have 

Type XI : / - 6"' ^(w ~ 


i) 1, - X 0 . (6.23) 

a X i) , . . (6.24) 

00 ... . (6.2r)) 


b .r < GO 


(6.26) 
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Finally, as a particular case of Type I when 5^^, ™ 6/5, ~~ 9 = 0, equations (6.4) become 
indeterminate. In this case we have 

Type XU ; / = ^ f m, 1 - m) 

a, <x . . (6.27) 

6.15. Pearson curves of Types I and III, and to a somewhat smaller extent, those 
of Types V and VIl, arise in the theory of sampling and would in any case have to be 
studied in that theory. Apart from this, the principal use that has been made of the 
distributions in the theory of statistics is in fitting them to observed distributions such as 
those of Chapter 1. It has been found that in many cases the Pearson distributions provide 
a remarkably good fit to observation. 

A systematic account of the technique of fitting will be found in Elcierton’s Frequency 
(\irves and Correlation (1938). We will here merely indicate the general principles and 
give one example of fitting in what is, perhaps, the most difficult case. 

6.16. All the Pearson distributions are d(itermim‘d by the first four moments, //'j 
to /q inclusive, exce})t some of the degenerate types which are determined by fewer than 
four moments. Pc^arson’s method of fitting consists of 

(1) determining the nimuuical values of the first four moments of the observed dis¬ 

tribution ; 

(2) calculating the numerical values of / 5 a , k (equation (i.l4) and hence determining 

the type to which the distribution belongs ; 

(3) equating tlu^ observed moments to the moments of the ax^propriate distribution 

exx^ressed in terms of its parameters ; and 

(4) solving the resulting equations for those parameters, whereupon the distribution 

is determined. 

The following example will illustrati' the process :— 

Example 6.1 

In Table 1.15 there are shown, in the column totals, a distribution of 9440 beans accord¬ 
ing to length. The figures are repeated in Table 6,1 on page 150. Required to fit a 
Pearson distribution to these data. 

For the moments it is found that, with Shox^x^urd’s corrections, 

(centre at 14-5) --- - 0* 190,783,898 

//2 = 3-238,424,951 

//3 -- 5-306,566,352 

4 == 50-999,624,044 

/5i =- 0-829,135,838, ^ ^ 0-910,569 

do == 4-862,944,362 

First of all, as to type. For the criterion k (fi.l4) we have 

^ + 3 )^ 

4(4^, - - 6) 

_ 51-262 j 

“ 84-040‘ 
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This lies between 0 and 1 and hence the appropriate curve is Type IV. We have to deter¬ 
mine a, m, V in 

N 


f 




— 1 :r 
tan — 


aF{2m — 2, 

3C 

Writing tan - and 2m — 2 = r we find 

== cos’*” ” 0 sin" 0 dO, 

J —ao 

whence, integrating by parts with cos'"”’" 6 sin 0 as one part, 

— -j{(w — l)a^;_2 — 


r — n 

a particular case of (6.3). Hence, in terms of moments about the mean, 

av 
r 


Ml 

Mi 

Mi 

M* 


= — “-(r2 + r2) 

r^r -ly ^ ^ 

^ 4ah'(r^ + v^) 

- *” -TKr— 2) 

_ 3a*(r2 H~ +“6(r2_+r^) - Sv^} 

H(r -^l)(r - 2)~(r 3)" ~ ’ 


whence it is found that 


r = 


6(/92 - p, ~ 1 ) 


2 / 9 , - 3 ^, ~ 6 

V{16(r - 1) -/?.(»■ - 2)^1 
" ^ "■ 

Substituting for /? 2 , and we find 

r = 14-697,72, m 8-348,86 

V =- 18-380,43 a ^ 4-159,49 

The signs here want a little watching, r and m present no difficulty ; but a is to be taken 
positive and v positive since \/pi is to be considered negative. 

From the tables of F(r, v) we evaluate the constant term k and finally arrive at 




* 18 3g0.4S tan-1 

e 4*159,49. 


17*301, 

The frequencies given by this curve are shown in Table 6.1 on page 150. 


6.17, The following points are worth noting in connection with the fitting of Pearson 
curves to observational data:— 

(1) Although the various types have dissimilar analytical equations they merge into 
one another in geometrical shape. For instance, Type V may be regarded as transitional 
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between Typeg IV and VI and is Tery similar to the shape assumed by those curves 
near k = 1. 

(2) It is tacitly assumed that the data can be represented by a curve with finite moments 
up to the fourth order at least. Curves for which higher' moments do not exist were 
called by Pearson heterotypic ; but there is nothing sinister about them except that they 
do not fall within the Pearsonian system. 

(3) In calculating moments, Sheppard’s corrections are usually to be employed when 
there are contacts of sufficiently high order at the terminals. In the case of J- or U-distri- 
butions the other corrections mentioned in 3.27 may be employed. This case sometimes 
raises difficulties in that the resultant curve does not start in the right place. In such 
circumstances there is no golden rule. The most satisfactory course is to try several curves 
(or the same curve translated to several points) and to judge by the results which of 
them gives the best fit. 

(4) The quadrature of Pearson curves, as indicated in the foregoing, may in some 
cases be effected by tabulated integrals ; but the more generallj^ ap^Dlicable procedure 
appears to be to calculate ordinates direct from the equation of the curve and then to 
find areas in ranges by Simpson’s rule, Weddle’s rule, or some similar process of quadrature. 

6.18. The mathematical description of an observed distribution by a Pearson curve 
may be regarded from two rather different standpoints. If our object (for instance in 
actuarial work) is to obtain a mathematical expression which will satisfactorily represent 
observation and allow of accurate graduation and interpolation, fitting by moments is 
generally satisfactory. The method has, however, been criticised when the observed data 
are regarded as samples from a population, and it is desired to find a mathematical repre¬ 
sentation of that population. In such cases the moments calculated from observation are 
only estimates of population-moments. It has been objected that they may be inefficient 
estimates, and alternative methods have been proposed. We shall have to defer a full 
discussion of this point until the second volume. 


6.19. Other systems of curves have been studied, mainly by Scandinavian writers, 
with a view to representing frequency functions by expansions in series. It is well known 
in mathematical and physical work that functions can often be usefully expressed as a 
series of terms such as powers of the variable (Taylor’s series) or trigonomotrioal functions 
(Fourier’s series). Neither of these forms is very suitable for frequency functions, but 
we proceed to consider another set of functions with more promising possibilities. 


TchehycheJf-Hermite Polynomials 

6.20. Writing 


and 


a(aO 


B = 


1 

V{^^) 

d 

dx 


consider successive derivatives of a(.c) with respect to x. 

DcfL{x) ~ — X0i{x) 

X>®a(a:) = {x^ — l)a(.'r) 
B^x{x) = (lix — x^)x{x), 


We have 


A.S. 


L 
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and so on. The result will obviously be, in general, a polynomial in x multiplied by ot(a?). 
We then define the Tchebyoheff-Hermite jKilynomial by the equation 

(- Dyoc(x) = II^(x)oc(x) .(6.28) 

Evidently Hr(x) is of degree r in x and the coefficient of x*‘ is unity. By convention Ho = 1. 
We have 

«{a; - 0 = exp + to - L*) = «(x) exp 

and also, by Taylor’s theorem 


a(x - <) = ^ ~F,(x)a(x). 


/=-() 


/-O' 


Consequently IIj.(x) is the coefficient of in exp ^fx — It follows that 
H^{x) ~ 


^[2] 

2V 


-f 


2^2!^ 


2^3! 


—.X 


(6.29) 


The first ten polynomials are 
Ho = 1 

Hi = X 

Ha = 0*2 1 

Ha =r= 

H4 = x^ — Gx^ I- 8 

Ho — — lC).r® f Ifir 

He =- .r« — 15^^ -I- 4r>.r2 ~ 15 

If, — 2]ji:6 4 10r)u;2 105a; 

.r® — 2Sa'® -f 210a'^ — 420a*® + 105 

Ho -= a^® 30a;’ -j- 378a*® 1260a’® + 94r).r 

Hio 45a*® + 630a*® - 3150a;« -f 4725.r2 — 945 


(6,30) 


6 . 21 . 

identity 


The polynomials have a number of interesting properties. Differentiating the 


exp 



‘ y-O 


with respect to x and identifying coefficients in r we have 

-^H,(a*) -- rH,^^{x) .(6.31) 

and generally D^H^ix) ^ ^x) ..... (0.32) 

Differentiating the identity with respect to i and identifying coefficients in we have 


Hy(a*) — a;H^_,(a*) + (r — l)//^_o(.r) 0. 

From (6.31) and (6.33) together wo find 


dx^ 


dH^(x) 

dx 


4- rH^{x) = 0 


. (6,33) 

. (6.34) 
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. (6.35) 


It is also known that the equation in x, Hf{x) == 0, has r real roots, each not greater 

in absolute value than ^ - \ (Cf. Charlier, 1931.) 

Tables of the values of the first six polynomials to 10 decimal places proceeding by 
X = 0 (0*01) 4 have been given by Jorgensen (1916). 

6^22. The polynomials have an important orthogonal property, namely, that 
j H„^{x)H^(x)x{x) dx ^ 0 m 9 ^ 7i 

^ n\ m = 7t 

In fact, integrating by parts, we have, if w ' 

f — (-— 1)^[ II^^^D^ocdx 

J — (X> J “00 

= (- 4 (- 

L — 00 

The term in square brackets vanishes and, in virtue of (6.31), the integral becomes 

m(— 1)"''M dx. 

J —oo 

(k^ntiniiing the process, we find either zero, if m is not equal to n, or m\ if m = n. 


The Grarn-Charlier Serie.^ of Type A 

6.23. Suppose now that a frequency function can be expanded formally in series 
of derivatives of a(a:). (We shall discuss the conditions under which such an expansion 
is valid below.) We have then 

CO 

/(a-) y^CfHf{T)x{x). 

7 " 

Multiplying by H^{x) and integrating from - oo to oo we have, in virtue of the orthogonal 
relationship (6.35), 

/(x)/i,(a-) f/a-.(6.:)6) 

The reader familiar with harmonic analysis will recognise the resemblance between this 
procedure and the evaluation of constants in a Fourier series. 

Substituting in (6.36) the explicit value of Hf(x) given in (6.29) we find 

1 f , , r'** , I 

~ 2 1!''^'"' “' ^ ’ J ’ ’ ’ 

In particular, for moments about the mean, 

c„ — 1 j 

C, - 0 

<•. "= l(f*is — 1) 

Pa = 

p4 = 2*4 (/^ 4 — li/'a + 3) " • 

Pa = rL.(/<a — 

C» -,i ()(/'« — 4 + 45/^, - 15) 

Pt = >,oVo(/W7 — 21/<5 + 105/<3) 

Ps = 4Trixo(/'8 ~ 28/4. + 210fi, — 420/4, + 105)J 


. (6.38) 
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Thus we find the formal expansion 

fix) = a(i;){l + Uh - 1)^« + + 3)^4 + . . . (6.39) 

If f(x) is in standard measure the series becomes 

fix) =a(a;){l f IfiJBli + ./^if^, - 'i)Ht 4 • • •} • • • (6.40) 

This is the so-called Gram-Charlier series of Type A. 


Edgeworth's Form of the Type A Series 

6.24* Consider the characteristic function of a term Hf,{x)oL(x), 


Since 


a(<) 




we have V(2;t)^ a(«) == (- l)Wi2n)H^it)xit) 

Cl t 


=: e 2 = 1 — 6 2 dx 

J-oo Vi^^) 

pOO 

J —a 


pXiJC 


. e dx 
V(27i) 


and thus the characteristic function of x^a{x) is i^\/{2n)H(t)oi(t), Conversely, by the In¬ 
version Theorem of 4.3, we have 

x^ix{x) ~f i^\/(27t)H{t)x{t) dt. 

27tJ 

Interchanging rr and t, wo find 

\/(2n){ — iyrcx.(t) = f e'(x)<x{x) dr 

J —CO 

and hence, changing the sign of that the characteristic function of H{j:)x(x) is \^{ 27 t)i^roL(t). 


Consider now the expression 


Its characteristic function is 


exj) {kj,D^)(x{x) 


(6.41) 


j* exp {K^lF)oc(x)dx = j* |~-^a(.r) dx 

=- f e^^jr^x{x) dx 

^ — <X- 

= 2 ;^’ et^i-\Ym^jix)xix) dx 

3 ^ J —CO 

= If^yi2n)i- iYHr>xit) 

= v'(27r) exp — {KfiiYcx,{t) 

In a similar way it will be seen that the characteristic function of 

exp { - + - 2 r^' ~ + S®* • • 


is equal to 

\^(2n)oi(t) exp 
More generally, if 




(6.42) 

(6.43) 

(6.44) 




= a-vW'‘ 
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the characteristic function of 


is equal to 




'\/{27i)(x.{ta)e^'*^^ exp 








as may be seen by the same line of argument. 

Now suppose that (6.45) represents a frequency function. Its cumulative 
is then the logarithm of (6.46), i.e. is equal to 

("■ -»+.”>*+1- - ?■ ^ (i,).+... 

and hence its cumulants are — a m, - b -\- a^y etc. 

take a ^ m and h = and thus we obtain a distribution whose cumulants are Ki 
etc. Now if these are in fact the cumulants of a distribution the series (11.45) 
equal to that distribution, provided that (1) the series converges to a frequency 
and (2) ii is uniquely determined by its moments. 

If we take the frequency function to be expressed in standard mt asure, then ki - 
and (6.45) becomes 

r 7)3 7)4 I 

expJ-Kj- + K.—- . . . la(a;) ==/(j-) . 


. (6.45) 


(6.46) 


function 


We may 

must be 
function, 

- 0 , I 


where we have written a(.r) for /?(.r) because now m vanishes and rr^ — ]. 

A series of this kind was derived by Edgeworth (1904), though from an entirely different 
approach through the theory of elementary errors. Equation (6.47) is formally identical 
with (6 40), and th(' reader who consults the original memoirs on this subject may be 
puzzled by the fact that Edgeworth claimed his series to be different from the Type A 
series and better as a representation of frequency functions. The explanation is that 
for practical purposes it is necessary to take only a finite number of terms m the series and 
to neglect the remainder. If we take the first k terms in (6.40) the result is in general 
different from that obtained by taking the first (A; — 1) terms of the operator in the expon¬ 
ential of (6.47). The argument centred on the fact (cf. Example 6.3 below) that the 
terms in (6.40) do not tend regularly to zero from the point of view of elementary errors, so 
that in general no term is negligible compared with a preceding term. 


6.25. In standard measure the relations (6.38) Ix^corne, in terms of cumulants, 

f'o = '’l <‘2 •= ] 


r 

* 120 s . . . . (6.48) 

= ) 10«i) 
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6.26, In the practical representation of frequency functions by the Type A series 
only the first few terms can be taken into account. The term in H^{x) has a coefficient 
dependent on and for r > 4, this is unreliable owing to sampling fluctuations. When 
sampling effects are not in question the series may be taken to more terms, usually not 
highei* than the term in We should then have to investigate how far the observed 

distribution can be represented by the series 

«(a:)(l - 1 - . • • (6-49) 

in the hope that the remainder after these terms could be neglected in comparison. 

It may be noted in passing that the distribution function of such a series is easy to 
obtain. If 

f(x) = Ea^^{x)cf.{x), 

then I f{x) — H^{x)oil{x) dx 

J — OO J —00 

= — Ea^H^^i(x) x{x). .... ( 6 . 50 ) 


TABLE 6.1 


Fitting of Pearson Type IV Distributio7i and Qram-Charlier Type A Series to the Data of 

Length of Beans (Table 1,15). 

(From Pi’etorius, 1930 .) 


Length of 
Beans 
(mm.) 


170 
16-5 
160 
16-5 
150 
14-5 
14*0 
13*5 
J3 0 
12 5 
120 
11*6 
11*0 
10 5 
10*0 
9 5 


Observed 

Frequency. 


6 

56 

275 

1129 

2082 

2294 

1787 

929 

437 

199 

115 

70 

36 


1 


Typo IV. 


! 

] Typ*' A. 

! (1) 


ff 

) 28 5 

^ 299-3 
1181 6 
2132-6 
2229 8 
1638-9 
968-9 
503 6 
243 7 
113 8 
52 6 


24-2 

11-3 

5-4 

2-6 


rl-9 


J 16 3 

J 12 8 

) 25-6 

^ 241 7 
1012-7 
2155 4 
2.593-0 
J 788-4 
713-4 
280 7 
258-7 
206-2 
98-7 
29-6 



Totals 


9440 


9440 


9440 


Typo A. 

( 2 ) 


Tyj)e A. 

(3) 


- 15-2 


13 7 
116 6 
370-4 


926 2 
1833-0 
2506-4 
2082-6 
921 3 


199-0 
132-1 
178 1 
117-0 
43-5 



{ 

J ~ 35 3 
] 22-3 

L 438-1 
1214-0 
1866-9 
2112-8 
1916-7 
1183 4 
371-2 
66-9 
101-2 
107-1 
54 0 


15-4 

{3-3 



9440 


9440 


(Tlio brackets mean tiiat the froqueneios shown are rounded up and include some small frequency 
in blank rows covere<l by the brackets.) 
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Example 6.2 

Consider the fitting of a Typo A series to the bean data of Example 6.1. 

We have already found the first four moments. In standard measure we have 

//a = - 0-910,569 
== 4-862,944 

and we also find //s == — 12*574,125 

fj, = 53-221,083. 

Hence the series is 

9440a(x){l - 0-151,762/^3 + 0 077,622,7 /^4 - 0 028,903,6/^5 + 0-014,273,5 He}. 
Table 6.1, on page 150, due to Pretorius (1930), shows the frequencies given by taking 
the first three, the first four and the first five terms of this series (columns headed Type A(l), 
Type A(2) and Type A(3) respectively). A glance at the figures will show that the four- 
and five-term series is no better than the three-term and, if anything, rathei worse. Further¬ 
more, the five-term series gives negative frequencies at one terminal and a mode at 12 mm., 
which is contrary to the data. The representation is clearly not very satisfactory and no 
better than that given by the Pearson TyY)e TV curve. 

Tefravhor/r Fiin ction ,s* 

6,27. The terms may be obtained from Jorgensen's tables combined with 

those of the exponential e Some related functions have also been tabulated in Tables 
for Statistiriayis and Biometricians, Parts I and II. The function 

"(r!)l " ' (r!> ’ ‘ * • V • ; 

is known as the Tetrachoric Function of order r, and tables arc available to seven places 
of decimals for r — 0 (1) 30 and x =- 0 (O-l) 4. In the notation of these functions, series 
(6.49) would become 

/(•»■) = T,(.r) 1 + y^^Ktr,{x) ■+ . . . 

and the particular series of Example 0.2 would bo 

f(x) = 9440{ti(^ ) — 0-743,477 T 4 (a') -f 0-850,313 T 5 (,r) - 0-775,565 T6(r) -f- 1-013,318 T7(^')}• 
The reason for the definition and the name of the function will appear in Chapter 14. 


6.28. Up to this point it has been assumed that a frequency function possesses a con¬ 
vergent Type A series. We shall not here enter into a discussion of the conditions under 
which this is so, except to warn the reader that a great many mistakes have been made on 
the subject and to quote some theorems without proof. 

(1) Cramer (1925). If f(x) is a function which has a continuous derivative such that 


r 

J-ooW 


e‘^ dx 


converges and if f{x) tends to zero as | ir | tends to infinity, then f(x) may be developed in 
the series 




. (6.52) 



m 

where is given by 
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= f dx. 

J *-00 

This series is absolutely and uniformly convergent for — oo < a; < oo. 

(2) A theorem by Cramer (1925) based on one by Galbnin. If j(x) is of bounded varia¬ 
tion in every finite interval and if 

f \f(x)\e^dx 

J -00 


exists, then the expansion of f(x) in the series (6.52) converges everywhere to the sum 
H/(® + 0) 4- f{x — 0)}. The convergence is uniform in every finite interval of continuity. 

Cramer has also sliown that this last theorem cannot be substantially improved upon 
as regards the behaviour of f(x) at infinity. Consider in fact the function f{x) = 

We have, in virtue of (6.33) and (6.31), 


e'~^*H^(x) dx = f rfa: — (r -- l)f 

J — CO J ~ oc 

" ’^(2^ “ ’)j i(x)dx. 


If r is odd the integral vanishes because is an odd function of x. If r is even, say 2r, 
the integral be*comc8 


, 2 , - 1 „ 2 , ■ 3 , . . . ^ 

^ iV 

x/(2A) 2‘r!\2A / ' 


The appropriate ooefficiont of ff 2 r Type A series is then 

X = 0, 1 / 2 . = ^ The series then becomes 

2'i'! 



Now when 


^~^/(2k)~2'^^(v\)\ 21) ' 

In virtue of the Stirling approximation to the factorial, the rth term of this, say becomes 
in the limit 

'\/{2X7ZV) 

1 1 

so that uv I — —. 

2A 

Hence, for A < J the series is divergent. 


6.29. From the statistical viewpoint, however, the important question is not whether 
an irtfinite series can represent a frequency function, but whether a finite number of terms 
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can do so to a satisfactory approximation. It is possible that even when the infinite series 
diverges its first few terms will give an approximation of an asymptotic character. 

This subject has not yet been fully explored and there has been some controversy 
about the value of the finite Type A series. Two things seem clear :— 

(а) The sum of a finite number of terms of the series may give negative frequencies, 
particularly near the tails (as, for instance, in Example 6.2). 

(б) The series in the Charlier form (6.40) may behave irregularly in the sense that 
the sum of Jc terms may give a worse fit than the sum of (A; — 1) terms. 

How serious these disadvantages may be depends on the purposes in view. So far 
as practical graduation is concerned it would appear that the finite Type A series is successful 
only in oases of moderate skewness and in many such cases a Pearson distribution is just as 
good. In many statistical inquiries we are more interested in the tails of a distribution 
than its behaviour in the neighbourhood of the mode, and it is here that the Type X series 
appears particularly inadequate. 

But this is not by any means a unanimous view. Arne Fisher (1922) has considered 
a modified form of the series which he claims to meet most of these criticisms. He considers 
the series 

/ = (Co + -f- . . . r,H,)a(.r) .... (6.53) 

but determines the c’s, not from the observed moments and the relations (6.38) but by the 
method of least squares, i.e. so that 

f c,// . . . 

shall be a minimum. The method involves some laborious arithmetic, but Fisher has 
successfully graduated a number of actuarial experiences by using it. 

Two other actuarial statisticians have pointed out the difficulties of the Type A series, 
Steffensen (1930) adducing some theoretical objections and Elderton (1938) summing up 
in favour of Pearson distributions. 



From the manner of the formation of terms in (6.48) it is evident that the coefficient 
Cy is the sum of terms where (^^ . . . q^) is a partition 

of r such that no q is less than 3. It will then be clear that, since is of order 2 , the 
term of greatest order in is that with the greatest number of parts in (#c^^ . . . 

For example, if r = 9 it is (3^), if r = 8 it is (4®), and so on. 
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From these considerations we can find the order in p of the terms in the Type A series. 
They are ‘ 

Term . . . *^0030405 Cg c® c^j, 0^2 

Order in /> . . .0 -J _1 -IJ _1 -ij _2 -1J -~2 -2^ -2 

The terms decrease in order of p, but not at all regularly, and it is clear that in general no 
coefficient will be negligible compared with a preceding one if p is large. The asymptotic 
qualities of such series obviously require careful investigation in particular cases. 

The Type B Series 

6.30. Just as the Tyj>e A is derived from the normal integral, a Type B series has 
been derived by Charlier from the Poisson distribution. Writing 

= .(6.54) 

X' 

for integral values of x, put 

p -rn Tt 

y(m, a;) = - — 1 gii^ i df . , . (6.55) 

^ Jo 

for all X. When x is integral this reduces to (6.54).* In other cases 

y{ni, .r) -sin ttt ^(— l)^^ .... (6.56) 

JT f{X - J) 

Write \ 7 y — y(w, x) — y(fny o' ~ 1 ) 

<30 

and f(x) - y^b^V>y .(«-C7) 

?-0 

This is the Type B. Charlier recommends it in cases of skewness when Type A is 
inapplicable (tliough the dividing-line is not clear). In theory it may be used for continuous 
variates, but in practice has only been applied to discontmuous variates proceeding by 
equal intervals. In fact, the objections to Type A apply a fortiori to the continuous form 
of Type B and various other complications apjxmr (cf. Steffensen, 1930). 


6.31. Defining polynomials by the relation 


y{m, x)Q^{m, x) - y{ni, x) 


. (6.58) 


we find that 


V 

G. ===: coefficient of — in e™* 
r> 


('+»)* 




. (6.59) 


♦ The integral 



eit - lyy subgititution =- z, ih 27t times the residue of 


^mz 


unit circle and is thus equal to 2 ;t 


xl* 


in the 
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In a similar manner to that used for the TchebyohefF-Hermite polynomials we have 


VG, = -G,_^ 
m ' 


. (6.eo) 


(ft.Ol) 


which may be compared with (6.31). It may also be shown that 

■ = . 

y(m, x) 

and tlms may be calctilated from the rth differences of the Poisson function y(m, t) in 
the same way that II^ may be derived from the rth differential coefficient of the normal 
distribution. 

The G'h also obey the orthogonal law 


oo 

^{Gfi„y) = 0. r 


r! 


. (6.G2) 


Thus if 


S = 


h - ■ 


TABLE 6.2 

Type B Series fitted to a Dlscordinvous Distrib'ution of Particles etnitted by a Radioactive 

Element in Units of Time. 


X 

Froqiu^ncy. 

Typo B 
(2 torms). 

TypeB 
(3 terms). | 

Typo B 
(4 terms). 

0 

57 

49*5 

1 

49 0 1 

58 2 

1 

203 

201-3 

201-0 

199-8 

2 

383 

403-4 

404-3 

386-1 

3 

525 

532-3 

533-8 

523-9 

4 

532 

520-6 

521 5 

532-1 

5 

408 

402-6 

402 5 

418-2 

6 

273 

254-8 

254-4 

260-2 

7 

139 

137 1 

136 7 1 

134-0 

8 

1 45 

64-0 

63!» 

56-7 

9 

1 27 

26-1 

26-2 1 

22 9 

10 1 

1 

9-4 

9-6 

8-6 

]1 

1 4 

3-0 

3-1 1 

3-6 

12 

1 0 

0-9 

0-9 

1-6 

13 

1 

0 2 

0-2 1 

0-8 

14 

1 

0-0 

0-0 

0 3 

Totals 

1 

2608 1 

1 

1 

i 2605-2 

1 

1 

2607-1 j 

2609-0 
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In the same manner as for Type A we have, choosing the constant m equal to jui, 

= 1 
6i 0 

bi == — m) 

bz = ^(//* — 3/^2 + 2m) 

^4 == 4- //8(11 — 6m) -f 3m(m ~ 2)} 

etc. 


Example 6A 

Table 6.2 shows the frequency of the number of alpha-particles (x) emitted by a bar 
of polonium in intervals of Jth of a minute in some experiments by Rutherford and Geiger, 
together with the frequencies given by the Type B series with two, three and four terms. 
The calt^Ulations are diie partly to A, Fisher and partly to Aroian (1938). 


The Normalisation of Frequency Functions 

6.32. Several of the important theoretical distributions occurring in statistics depend 
on some parameter n in such a way that as n tends to infinity the distribution tends to 
normality. For large n it is often a sufficient approximation to assume the distribution 
normal, but for small or moderate n this may be hardly exact enough. In such a case 
we are nevertheless able to use the normal integral by seeking for a variate transformation 

f ao H- ciiX -|- + a^x^ -f- . . . . . . . (6.65) 

where the a's are of order 72 “^ or smaller. By choosing the a’s appropriately we can bring 
the distribution of much nearer to normality than that of x and hence find tlie distribution 
function of x from that of assumed normal. 

Consider in fact the Edgeworth form of the Type A expansion (6.45) 

C*P {- ■ - 2^* + ■ . ■}„ ■ (0 «) 

We have retained the terms in I) and because the approximation may perhaps be slightly 
improved by taking m and a* in the f-distribution not quite equal to the mean and 
variance of x. 

We now assume that the cumulant is of order a case of fairly common occur¬ 

rence ; that Ki ~~ m is, by choice of m, of order n~ ^ ; and that kz — o*, by choice of cr^, 
is of order n~^, so that we may write 

— m — liO li = 0 (r 2 “*) 

K 2 — = 1 ^ 0 ^ I 2 == 0(n“"^) 

Then a* is of order /c*, i.e. and thus 


!»• 

or^ 


= 0(n’“^"). 


Thus (6.66) may be written 
exp l^crD -f 




•} 


■\/{2n)a 




(6.67) 
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where and U are 0 (n~*) 

Zj and Z 4 are 
U is 

Ze is 0 (w.~ 2 )^ etc. 

Expanding the operator and retaining only terms up to and including 0(v'~^) we find 
for the operator 

1 ^ l,aD + ^ i^oha^D^ -f- tUUo^J^ 4 

1 / 2 ^ 42)4 ^ 4 - - hha^D^ 4 ihha^D^ - ,\hhaW^ 

+ ^ + ^hho^D^ - ^,hhaW^ + ^,hha^D^) 4 J ( “ 

~ lIlhcfiD^ - mha^Jy^ + -.i^nhcr^oD^o - 
4 + lhhha»D» + hhhho^^D^) + ^ 

t ^JihcfiD* + + ,\Ul<r^or,io) .(g 

The result of this operation is a similar expression, which we will not b( f^her to write 

( Xfiv\ 1 

---j and multiplied by “^^ 7 ^ 


,(/-/»)* 


f 2fT* 

The distribution function is given by integrating this expression, and we then have 
for the frequency less than or equal to m + ox (arranging the terms in order of 
magnitude in n) 

f' , e {U + ^hH,) - + IIJI, + \hhH, 

\ (iTt) V\^^) 

^ .\hih t- - (lliH, + IkhH, , 4 >\hhH, 4 

^ 4 ;aiih> + A.hhH. -\ (Ai^a T -i \niji. 

+ i'b^I^3^6 + Tshhhfls H t “h 

-r -A-Jinn. + + ,i-rhhlM, ' ArMH. + tJMH, 

f (- .(6.61») 

6.33. Now let ^ be a normal variate. We will determine £ in terms of x such that 

. 

F{x) being the distribution function given by the Type A exyiansion (6.69). 

We have 




1 , 

I —_ . e 2 o(/ 

J-ooV(2^) 


{X - £) d 


r -J_ 

1 ' dx] _^\/{2n) 


_» 

: e dy 


etc., 


by Taylor’s theorem, 




2 ! 


3! 


(6.71) 


.V(2^) 11 

and this is equal to (6.69). 

The next step is to invert this series so as to give {x — f) in powers of x. Assuming 
X — ^ = Uq 4" 4“ 4“ • • • ®tc., . . • (6.72) 
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we ^ that when re = 0, | = — a#, x — f is of order ; and hence, to order n~ * we have 
from (6.71), with x = 0, 

and this is equal to the expression in square brackets in (6.69) with x ^ 0. 

We then find 

== Zi *4“ '6 ^^8 + "f* 4“ 4^^* 4* 

We can now find in (6.72) by identifying coefficients in x, and so on. After some algebraic 
reduction we find, writing the terms in descending order in n, 

X - f + l(,(x* - 1) + ihx - Ihhx + - 3*) - - 7x) - ll,h 

-A(A(5x* -3) ~\hUx^ -1) -6x* +3) +^(iZ|(12x* -7) 

- t1t^,^*(11x* - 42x* + 15) + 5ig?i(69x‘ - ]87x + 62) - sp^x + Ihhhx 

+ — -^hhilx^ — 15x) - aVWs(x3 - x) + 7 jf,?«(x» — lOx* 4- li>x) 

- ~ 49x) - - 32x» + 35x) + :,\hhh{l^x^ - 21x) 

- 'sUhWx^ - 48x* 4- 51x) - ..'tZ.ZKISSx* - 187x) + ^l^PMUlx^ 

- 547x» + 456x) - t-J^Z|(948x» - 3628x® + 2473x).(6.73) 

This is our required expression of the variate $ in terms of the variate x. To order 
w~® at least § will be normally distributed. 

It is often more convenient to express x in terms of S. This may be done by noting that 

X - i = g(x) =r gr(| -f x -- ^) 

= g($) + (X ~ f)5r'(f) 4^. . . 

- 9i^) + {7'(f){9(l) + x”->. 9 '(f)} 4- . . . 

and by continuing the process 

X - f - gm 4- g($)g'(S) 4- gWHS) 4- lgH^)g"m 4- g(S)g'H^) + }gH^)9WiS) 

+ +.(«.74) 

Hence, using the value of f given by (6.73) we find, after some reduction, 

X - I = Zi + - 1) + 4- - 31) - - 6f) - iW,(f* - 1) 

+ - iK"* + 3) - + 2) 4 - r>3|2 4- 17) 

- - 31) 4- yJ„Z,(f6 - 10t=* 4 ].5f) + - 25f) 

- - 24f« + 29f) - - 17s« 4- 21f) + -L,-Z|7,(14f^ 

- 103st=> + 107f) - ,,Vii4(2r>2f» - 1688^3 q. 1611^) .... (6.75) 


Example 6.5 

Consider again the distribution of Example 6.3— 


dF — ^x*’ ^ dx 

A|>) 


0 < X < 00. 


We have already found that, in standard measure, this tends to the normal form, and 
that is of order p . 

We will take Zj and h of (6.67) to be zero, which implies that our normal variate S is 
to have the same mean and variance as that of x. We have 


Za == 2^*“* Z4 = 6^"“^ h = 24p~^' Zfl = 1202)** 2 ^ 
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(6.69) then becomes 
r —L- - e-*^‘ dx 


1 


V'(2^) 

1 


e-i-'*/. 




18j) 


+ 




1 




5p 

-.H, 


+ — H, + 


■}■ 


12jp 


162p 


.Ha 


12p^ ‘ 1944^2 

Let US, as a simple illustration, find the distribution function of x for p = 9, a; = 12. 
The mean of the distribution is then 9 and its variance 9, so that this corresponds to 
a deviation (12 — 9)V^ in standard measure, equal to unity. It is found from (6.30) 
and an additional equation for i/n that 

H, - 0, Ha - -- 2, ^ 2, H, = 6, He = 16, H, == - 20, He - - 132, H, - 28, 


H, 


1216 , Hi 


936. 


We then find for the distribution function 


1 


1 

_oc \/ ' 2/71 


(lx f 


1 


V(27i) 


€"2(0-015,163,5). 


The values for the normal function are obtained from the tables and we get the value 
0-841,345 f~ (0-241,970,7)(0-015,163,5) -= 0-S^5o, 

which is exact to four places. The approximation is evidently fairly good, even for values 
of p as low as 9. 

We could have found the same result by using (6.73). Substituting .r ~ 1 in that 
equation we find 

= 1-015,386, 

and the distribution function for the normal integral with deviate equal to this value of 
ir is 0-8450 as before. 

Suppose now we wish to find the deviate x whose distribution function is F{x) 0-99 
when 2‘> = L^- 

The normal deviate | corresponding to such a value is found from tables to be 2-326,348. 
We then have from (6-75) 

x-(= - 1) 4 - 3f) 4, etc.. 

which will be found to give 

a: =- 2-697,22, 

This is the value in standard measure. The deviate in ordinary measure is 

15 + = 25-45. 

This is exact to two places of decimals. 

The example shows that, notwithstanding the non-convergence of the infinite Type A 
series, a satisfactory approximation may be obtained from its first few terms, at least in 
certain cases. We may remark without proof that by an adaptation of a procedure given 
by Cramer (1928) it may be shown that an asymptotic expansion does in fact exist for 
the distribution of this example. 


NOTES AND REFERENCES 

An excellent account of Pearson's distributions is given in Elderton's book. Examples 
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EXERCISES 

6.1. Show that for the Pearson distributions 

d log 1 / _ X 

dx Bq -f“ BiX “f” 

the range is unlimited in both directions if Ro + Bi^ + B^x^ has no real roots ; limited 
in one direction if the roots are real and of the same sign ; and limited in both directions 
if the roots are real and of opposite sign. 

6.2. Show that the Pearson Type VI curve may be written 



and dl-^cuss the relationship with the Typo IV curve. 

6.3. Assign the following distributions to one of Pearson’s types:— 

dF = dx 



dF ~ Aj(1 r^) dr 


(All these distributions are important in the theory of sampling.) 

6.4. Show that for the Type B series the coefficients of equation (6.03) may be written 
symbolically— 

t>j = -?.(// - 

= • • -j 

(C. Jordan, 1927.) 


6.5. Show that, in the notation of 6.30, 

d 


yy(m, x) 


dm 


y(m, X i), 


Hence that 


A 

^y{m, x) = 1 - + 1), 


A.8. 


M 
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wbere is the incomplete F-function ; and hence that the sum of the first (A + 1) terms 
of the Type B series is given by 

6o{l — + 1)} — {hi “I 

(C. Jordan, 1927.) 


6*6. Show that if y is a function of x which it is desired to represent approximately 
by the form 

?_ 

y == yoH,(y)a(-e), 

then the values of the c’s appropriate to the expansion of y in this form are such as to 
minimise the sum 



y-0 


2 

y dx 


6,7. Show that for a Pearson distribution 
function obeys the relation 


if 


a -|- X 


f ho h^x ~\- b^x* 


the ehara(‘teristic 


h^O -| (1 “t- 26a + ^1^) ^ + hoO)(j> — 0, 


where 0 •= it. D€>duce the recurrence relation between the moments. 
Show also that the cumulative function obeys the relation 


hM- 


dhp 


f- 


\ ^ ^^oO) ~ 0. 


(rfo) } ^ 

Hence show that the cumnlant.s obey the recurronco relationH 

{1 -t- (r + 2 )b 2 }K, I rb,K^ t 1 ^ o ^ ! 




6.8. Show that no distribution which is not completely determined by its moments 
can be expanded in a convergent Type A series. 


6.9. If the distribution 

dF — ~ ^ — 00 - X 

V 


is transformed by 
and 

show that 


=- ];(logio f - 0 

~ -- Iogi„e, A = e*'’*’, 

- A*(A 4 3) 4 

/9, - 3 = 1^(1“ i 2A + 3) - 6 

-- ‘^/4(yj)‘‘ - y'l = 0, 


00 


and that 
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where (a\ is the first moment about the start of the transformed curve. Thence that 

I = 2 1og/<; - ilog(^, + 
bk^ = 2 log ft I — 21. 

6.10. Show that if a function in standard measure is expanded in a Type A series 
the coefficients of the second and third terms depend respectively on and and thus 
l)rovide measures of slcewness and kurtosis. 



CHAPTEIi 7 

PROBABILITY AND LIKELIHOOD 


7.1. The previous six chapters have dealt with the theory of statistical distributions 
from a descriptive point of view. It has been explained that the distributions occurring 
in practice exhibit certain regular features which permit of representation by mathematical 
forms ; that they caA be characterised by certain parameters such as moments and cumu- 
lants ; and that certain general theorems about distribution and frequency functions can 
be deduced. Wo now begin a study of a different kind, namely, the inquiry whether any 
statements can be made about populations or their parameters and distributions when 
only a sample of the populations is available for scrutiny. Except in trivial cases it is 
not possible to make any statements on these matters with the categorical certainty of 
deductive logic ; but it is possible, and indeed it is necessary if scientific inquiry is to go 
forward^ at all, to make statements of a less definite nature in terms of probability. In 
this clfaptor we shall accordingly be concerned with the theory of probability as it affects 
siatjfStics and in subsequent chapters with its applications in statistical theory. 

7.2. In ordinary speech we use the words ‘‘probability'’, “chance” or “likeli¬ 
hood ” to describe an attitude of mind towards some proposition of whose truth we are 
not certain. We say that it is improbable that life exists on Mars, that the chances are 
that if a penny is tossed ten times it will come down heads at least once, that it is likely 
to rain to-morrow, and so on. It is rarely indeed in practical affairs that we are confronted 
with a proposition of whose truth we arc absolutely certain. Nevertheless, we often have 
to assume that such propositions are true or untrue in order to reach decisions and to act 
in a rational way. 

The attitude of doubt we adopt is described in terms of probability. We say that 
the propositions are more or less probable and accept or reject them accordingly. 

7.3. A little introspection will convince the reader that all the attitudes of mind to 
which we relate the concept of probability have certain things in common :— 

{a) They concern propositions. The mind considers a proposition which has meaning 
and assumes towards it a certain attitude of doubt. It is very common both in mathe¬ 
matics and in statistics to speak of the probability of an event, or oven of a variate-value ; 
but these are condensed expressions for the proposition that an event will happen or that 
a member of a population has a given variate-value, and, though very convenient shorthand 
expressions which will often be used in the sequel, must not be allowed to obscure the 
essential fact that propositions are concerned. 

(6) There are degrees of probability. We say that it is very improbable that a hundred 
tosses with a penny will not result in a head ; that it is more probable that horse A will 
win a race than that horse B will do so ; that the probability of having wet weather in the 
course of an English summer is so great as to be near certainty. But it does not follow 
(and some writers on the logic of probability do not admit) that every pair of probabilities 
can be compared. It could with consistence be maintained that, whereas we may compare 
the probability of getting ten trumps in a game of cards with that of getting eight, there 
is no way of comparing the probabilities of the propositions, say, that there exists a planet 
outside the orbit of Pluto and that the human race will ultimately go bald. 
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(c) The degree of probability attributed to a proposition varies according to the amount 
of relevant evidence available to the particular mind considering the proposition. If we 
know that a horse has won its three previous races we atta,ch a greater probability to the 
proposition that tt will win the next. If we know that a penny has heads on both sides 
the probability that it will come down heads when tossed is so great as to amount to 
certainty ; and so on. 

{d) Pursuing this last point, we see that certainty can be regarded as a limiting form 
of probability. As a proposition becomes more and more probable it tends towards certain 
truth ; as it becomes more and more improbable it tends towards certain untruth. 

7.4. The object of the theory of probability is to give to the somewhat indefinite 
notions described above the precision of a science, and, since numerical measurement is 
the greatest precision which a science can possess, to measure probability numerically. 
Several writers have explored the more general problem, foreshadowed early as Leibniz, 
of developing a logic of probabilities, and the reader who is interested may refer to the 
work of Keynes (1921), F. P. Ramsey (1931) and Johnson (1921-4). From the statistical 
viewpoint the interest of tliis subject centres in the numerical theory of probability which 
alone will concern us in this book. 

It IS at this point that we arrive at the first of the differences of opinion among 
authorities on the theory of probability. Some writers try to include all the ideas generally 
associated with the word “ probability within the scope of their theory, which is thus 
applicable to any of the attitudes of doubt covered by the meaning of the word. The 
principal modern exponent of this viewpoint is Jeffreys, whose book (1939) should certainly 
be read by all serious students of the subject. Most statisticians, on the other hand, are 
concerned with the probabilities of j)ropositions of a particular kind, namely, those which 
form the members of populations of propositions. Under the more general theory, it has 
meaning to speak of the probability of an isolat(‘d proposition such as the one that Shake¬ 
speare’s plays were written by Francis Bacon. In statistics we are more usually concerned 
with the proposition which assorts the happening of some (went which could have arisen 
in a specified number of ways, such as the throwing of a number with an ordinary die. 
The finst approach takes probability to be an undefined idea, lilvc the straight line of Euclidean 
geometry, and builds up the theory from certain axioms. Tlu' second approaeli seeks to 
define probability in terms of the relative frequency of events and thus to throw the theory 
back on to the x^^ire mathematics of abstract ensembles (Kolmogoroff, 1933) or to the 
limiting properties of sequences (von Mises, 1936) The reader who is perplexed by the 
controversy between the adherents of the axiomatic and the frequency theories will find 
many of his difficulties resolved by the consideration that the two theories cover different 
domains of thought, or rather, that the axiomatic theory attempts to covei’ a wider domain 
than the frequency theory. 

7.5. This, however, does not explain away the whole of the difficulty, and the reader 
will have to choose for himself among the various possible sets of fundamental ideas forming 
the starting-point of the theory. When we consider the concept of probability^ as a psycho¬ 
logical matter we can either suppose that further analysis is impossible or unprofitable, 
in which case the axiomatic approach seems inevitable ; or we can ask how the mind comes 
to take up an attitude of belief in propositions which confront it. It is not necessary here 
to go into this question at length, but there would, in my own opinion, be a considerable 
measure of agreement that the concept of probability is founded on our experience of the 
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frequency of observed phenomena. When we say that the probability of a coin coming 
down heads on being tossed is ono-half we have in mind, I think, that if it is tossed a large 
number of times it will come down heads in approximately half the cases. Even in extreme 
cases, say, when we attempt to assess the probability of a horse winning a given race, an 
event which cannot be repeated, we are, I think, picturing our estimation as one of a number 
of similar acts and assessing the relative frequency of tlie horse’s victory in that population. 

But it has to bo admitted that, even if this be true, there is no necessity to use the 
concept of frequency in the axiomatisation of the theory. The concept of a straight line 
may very well be founded on our experience of the local properties of rays of light, but it 
does not follow that the indefinables of Euclidean geometry are to be analysed into optical 
concepts. 

llie ^sic Rules of Direct Probability 

For our present purposes the problems of fundamentals may be passed over, 
since all parties are agreed on the rules governing the calculus of direct probabilities. (The 
so-called ‘‘ inverse ” probabilities will require more discussion and will be dealt with later.) 
We therefore enunciate these rules without attempting to deduce them from more primitive 
propositions. 

Tn the first place it is assumed that probability is measurable on a continuous scale, 
so that any probability can be expressed as areal number. We shall, in fact, say that a 

number. This assumption implies, among other things, that any 
two probabilities may be compared ; for if they are measured by the numbers x and y 
we may say that the probability of the first is greater than, equal to, or less than, that of 
the second according as x > y, a* = ?/, or x < y, 

7.7. The probability of a pro 2 >osition q on data p is written P{(j | p). W(‘ have then 

Rule 7:-™- 

If p entails q, P(q | p) — 1 . . . . . (7.1) 

If p entails not-^^, P{q | p) ~ 0 . . . . (7.2) 

This rule defines the end-points of our scale of 2 )robability. Certainty that a 2 )ro 2 ^osition 
is not true is represented by zero, certainty that it is true by unity. Any probability lies 
in the range 0 to 1, 

7.8. Rule 2 .—If </i . . . q^^ are a set of equally probable and mutually exclusive 
propositions on data p, and if Q is a subset of w of these propositions, then 

nQ\v)- Z . 

/ 

^ This proposition is the starting-point of the frequency theory of probability. It is 
usually stated in some such form as : if of a set of n mutually exclusive and equally j^robablo 
events m are distinguished by some characteristic A, the probability of an event bearing 
^ 

A IS —. 
n 

s>^The objection to this rule from the logical viewpoint is that it contains the concept 
“ equally probable ” and is thus circular if one adopts it as a definition. The mathematical 
theorist dealing with probability, in the mathematician’s facile way, overcomes this trouble 
either by accepting the circular definition, or by defining probability purely as a property 
of sets of points. For example, such a definition might be : if of an aggregate of objects 
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n in number m are characterised by some quality A, the probability of any member bearing 

A is, by definition, the number To take a more sophisticated line, we can regard the 

objects as points of a set, attach set-functions to them obeying certain axioms and postu¬ 
lates, and thus build up the theory of probability as a branch of the theory of set-functions. 
An^^ verification of the theory, any test whether it provides a reasonably accurate picture 
of the way things happen in the world, is referred to experimental physics. The mathe¬ 
matician, of course, is used to this devolution of responsibilities, but the statistician is 
concerned with concordance between theory and practice and cannot always leave experi¬ 
mental verification to others. 

'^7.9. Rule 3.—If the probabilities of n mutually exclusive propositions gi . . . 
on data p are Pi . . . P^, then the probability on data p that one of them is true is 
Pi j P, . , . + P^. 

This is generally known as the “ theorem of the addition of probabilities Tn the 
language of the textbooks, the probability that one of n mutually exclusive evfuits will 
ha[)pen is the sum of their separate probabilities. 

V 7.10. Rule 4 .—The probability of two propositions q and r on data p is the product 
of the probability of q given p and that of r given q and p. Symbolically, 

P{qr 1 p) = P{q \ p)P{r \ qp). .... (7.4) 

Since q and r appear symmetrically wo also have 

P(qr I p) = P(r i p)P(q \rp). . . . . (7.5) 

From the frequency standpoint this rule is almost self-evident. If of a set n, {a) bear 
the characterislic A, {h) the characteristic P, and {ab) both characteristics, then the rule 
states tlial 

{ab) _ (a) (ab) _ (b) (ab) 
n n ' (a) n (b) ' 

a simple arithmetical proposition. 

More generally we have 

Piq^q^ . • . ?* I p) = P(<Zi I p)i'(q2 1 qiP)Piq» I q^qiP) • • • Piqk I • • • qd>) (7-fi) 

a result which follows from the repeated application of Rule 4. 

If, as a particular case, 

P{qr I p) = P(q | p)P{r \p) .(7.7) 

we have, in virtue of (7.4), 

P(r I p) = P{r I qp), .(7.8) 

and q is then said to be irrelevant to r, given p. A knowledge of q does not affect the 
probability of r on data p. 

7.11. The above four rules and various elaborations of them provide the basis of 
the direct theory of probability, which is concerned with problems of the type : given a set 
of propositions with known probabilities, determine the probability of some contingent 
proposition. This is a branch of pure mathematics and will be found discussed, for example, 
in most textbooks of algebra. Ultimately ail problems in this branch of the theory are 
reducible to the counting of the number of ways in which certain events can happen. The 
following examples will illustrate the type of investigation involved. 
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Emmple 7.1 

What is the probability that a specified player will get a hand containing 13 cards 
of one suit at a single deal at a game of bridge ? 

We have to consider here the total number of ways in which a given player can be 

dealt a hand of cards. There are 52 cards and 13 can be chosen from them in ^^ 3 ^ ways. 

Of these ways only four will contain cards of one suit. 

We then assume that all the possible deals are equally probable and are thus able to 


apply Rule 2 . 


Here vi = 4 and n — 



, so that the probability is 


P = 



4.39! 13! 


Factorial expressions of this kind may be found from tabled logarithms of factorials or 
by the use of the Stirling approximation. In this particular case we find 

P = 6 X 10"“^® approximately. 

/ 

Example 7.2 

n letters, to each of which corresponds an envelope, are placed in the envelopes at 
random. What is the probability that no letter is placed in the right envelope^ ? 

The condition that the letters are put in the envelojjes “ at random is to be inter¬ 
preted as meaning that every j)ossible way of assigning the letters to envelopes is (Mjually 
probable. The question, under Rule 2 , then reduces to the purely algebraic one : in Avhat 
proportion of the possible cases does no letter get into the right envelope ? 

Suppose that is- the number of ways in which all the letters go wrong. Consider any 
two letters. If these occupy each other’s envelopes, the number of ways in which the 
remaining n — 2 letters can go wrong is 2 ; and there are (?/ — 1 ) ways in whicli two 
letters can be interchanged. But if one letter occupies another’s place and not vice-versa, 
which can happen in (/? — 1 ) ways, there are ways in which the others can go wrong. 
Hence we have the difference equation 

- (7? - l)K_i f 

We may re-writt^ this 


~n ^ I 

and putting 
we find 

- (ir*-V 

Thus =r (— 1 )’^ 


But i/j = 0 and 7^3 == 1 and thus 




n 



1 

3] 


+ . . . 


(- i)n 

n\ y 


whence 
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The total number of possible ways is n! Thus the probability required is 

1^1 

2! 3! * ‘ ‘ ’ 

i.e. the first (w — 1 ) terms of 1 — 

/ 

'^Example 7»3 

Three pennies are tossed. What is the probability that they fall either all heads or 
all tails ? 

We assume that the probability of a head with any penny is J and that the result 
with one penny is independent of that with the others. Then there are eight possible 
and equiprobable cases, HHH, HHT, HTH, HTT, THH, THT, TTH, TTT, Two of 
these give us all heads or all tails and hence the required probability is 

Now consider this argument : there are two possibilities, either the three coins all fall 
alike or two of tliem are alike and the other different. Of these two possibilities one is 
of the type required and therefore the probability is 

Consider also this argument: there are four possibilities, three heads, two heads and 
a tail, two tails and a head, three tails. Two of these four are of the type required and 
therefore the probability is 

Finally, consider this argument: of the three coins two fall alike. The other 

must either be the same as these two or different. Thus there are two possibilities and 
again the chance is 

These three arguments are fallacious. They assume equiprobability among events 
which are not equiprobable and the application of Rule 2 is not legitimate. For example, 
in the first case, it is true that thei*e are two possibilities, but they are not equal under 
our a 8 Sum[)tioiis. The reader may care to examine why this is so and how the other two 
arguments break down on the same point. 

^'Example 7A 

Peter and Paul play a game wdth two dice. Peter pla 3 ^s first by throwing the dice 
together. If the total number of points is a prime number other than 2 he wins outright ; 
if it is even he throws again under the same conditions ; in other cases the throw passes 
to Paul, who throws under the same conditions. What is the probability of Peter’s winning ? 

It is to be assumed that the probabilities of throwing any number 1 to 6 with either 
die are equal. The possible throws are 2 , 3, 4 . . . 12 and the number of ways in which 
they can occur are :— 

Total points . . .23456789 10 11 12 Total 

No. of ways ...12345654 3 2 1 36 

Thus, according to Rule 2 , the probability ( 1 ) of throwing a prime is ( 2 ) of throwing 
an even number is (3) of throwing neither is 3 ^. 

These three events are mutually exclusive. Let P be the probability of Peter’s win¬ 
ning. Now if Peter throw's a prime other than 2 he wins outright, and the probability 
of his doing so is thus ; if he throws an even number he throws again, and his proba- 

Igjp 

bility of winning in this case (according to Rule 4) is ; if he throws neither the throw 

ot) 

passes to Paul, whose chance is then P, so that Peter’s chance of wdnning is ^-(1 — P). 
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Thus, according to Rule 3, we have 

P 

giving 


» + 1 ? +_ P), 


r = 


18 

22 


7.12. It is possible to carr^^ mathematical problems on the foregoing lines to great 
lengths, and a considerable amount of ingenuity has been expended in doing so. The 
important thing to note from the point of view of the theory of probability is that in all 
such cases certain probabilities are stated a priori, either explicitly or implicitly in some 
such form as the dice are perfect or the selection is made at random One of the 
most formidable j)roblems of statistics is that only in exceptional cases is there any prior 
certainty about the probabilities of observed events. 


Probability in a Continmim 

7.13. Up to this point we have considered only probabilities of finite and discrete 
events ; but we may also ask whether any meaning can be attached to probabilities in 
a continuum. For example, if a square is inscribed in a circle, what is the probability that 
a point taken at random in the circle is also inside the square ? If a line is divided into 
three segments, what is the probability that they can form a triangle ? What is the proba¬ 
bility that X < Xo where a: is a positive real number less than yo V And so on. 

All probabilities of this kind must be considered as limits. Consider the first example, 
that of the square inscribed in the circle. Imagine the whole figure divided into small 
cells of area r by a rectangular mesh. If we assume that the occurrence of a point in a cell 
is equally probable for all cells, the probability that a point falls inside both circle and 
square is the ratio of the number of cells in the latter to those in tlio former, neglecting the 
cells at the edges which become of diminishing importance as e — ► 0 . In fact, the required 
probability can be made as near the ratio of the area of the square to that of the circle as 
we please by taking e small enough. We may say that the probability is that ratio, which 
2 

is easily seen to be an incommensurable number. 

We should get the same limiting form of probability if wo took other meshes which 
adequately represented areas ; but it is most important to specify the method of procession 
to the limit in speaking of probabilities in a continuum. Otherwise the result has no 

n>eaning. The following example will illustrate the point. 

/ 

^ / 

^ Example 7 f) 


Consider a straight line OA bisected at B, What is the probability that a point chosen 
at random on the lino falls into the segment OB ? 

Lei US suppose in the first place that the lino is divided into n equal segments of length 


OA 

If we interpret the choosing of a point at random to mean the choice of one of these 

intervals, the probability is obviously | as n —> co, for there will be half the intervals 
in the segment OB, 

Now let OP be drawn perpendicular to OA and equal to it in length, and imagine a star 


of -f 1 lines drawn through P, including OP and PA, so as to divide the angle OP A 
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into equal angles These lines cut off segments on OA^ and we may, if we regard 

equal angles as having equal probability, assign to these segments an equal probability, 
for they subtend equal angles at P. If we make this convention it is evident that as 
'n CO the probability of a point falling into any segment on OA is proportional to the 
angle subtended at P. For example, the probability that a point falls in the segment OB 

is tan“^J 

Now this is not the same answer that we got by assuming all small segments of OA 
equally probable. There is nothing paradoxical in this—the two answers are different 
because the two limiting processes were different. On a little reflection it will be clear 
that by moving the point P on the perpendicular to OA and taking a star of lines as before 
we can make the })robability of obtaining a point in OB have any value we like. It is 
thus abundantly clear that the concept of probability in a continuum depends on the limit¬ 
ing process by which that continuum is reached from a finite subdivision of oquiprobable 
intervals. 

7.14. We have spoken above of the selection of objects “ at random In the 
mathematical theory of probability it is customary to define randomness in terms of proba¬ 
bility itself. A member of a jjopulation is said to be chosen at random if it is chosem by 
a random method ; and a random method is one which makes it equally probable that 
each member of the j)opulation will be ehosen. Randomness is extremely important in 
the theory of samjfling and we shall consider it at some length in the next chapter. At 
this point it is sufficient to note that when we speak of random choice we really mean 
a method of selection which gives to certain propositions an equal probability and l)ence 
allows us to apply tlie calculus of probability a 'priori. The justification for this is, in the 
ultimate analysis, empirical. It is found in practice that there exist selective processes 
which educe members of a j)opulation in such a way that the constituent events ma^^ be 
regarded as equiprobable ; and the theory of sampling is largely concerned with samples 
generated by such processes. 

It may be noted that, for continuous juobabilities, randomness is dependent on the 
process to the limit just as probability itself is. 



77?c Approach of von 

7.15. Suppose now we have a population of objects, each of which bears one of 
a number of characteristics. To simplify the exposition we will suj)pose that there are 
two characteristics denoted by 0 and 1. Suppose we draw members from this population 
and replace each member after drawing. Then the process of continued selection will 
generate a series such, for example, as 

K ^ 01100100111010111100100 . (7.9) 

VonMises (1936) takes as the foundation of his theory of probability an infinite sequence 
of this kind, the Irregular Kollektiv, obeying the following laws ;— 

(а) The proportions of O’s in the first n terms tends to a limit as n oo. This limit 
is called the probability of the zero in the Kollektiv. 

(б) If a subsequence is picked out of the Kollektiv by some method which is inde¬ 
pendent of the Kollektiv itself (e.g. every third member, every member whose ordinal is 
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a square, every member following a zero, etc.), the limit of zeros also tends to p for n —► oo ; 
and this for every such subsequence. 

The Irregular Kollektiv might, in fact, be described as the infinite random series. It 
has no systematic qualities ; for if, for example, the series consisted of repetitions of 
0110, thus 

K = 011001100110 .(7.10) 

the subsequence consisting of every (4r + 3)th would consist entirely of unities and the 
condition (6) would be violated. 

7.16, It is not difiicult to show that probability defined in this way obeys the four rules 
enunciated earlier in this chapter. Some authorities have, however, found difficulty in 
accepting the basic concept of the Irregular Kollektiv and attributing any meaning to its 
existence. It has even been claimed that the idea is self-contradictory, though this von Mises 
strongly contests. 

However this may be, the von Mises approach represents, in my own opinion, the nearest 
to a satisfactory basis of the frequency theory of probability that has been given. The 
mathematics of the subject are much the same in any of the frequency theories once the 
fundamental rules have been established, but when it comes to relating tlieory to experience 
the von Mises method has decided advantages. For a discussion of this subject, reference 
may be made to the works listed at the end of this chapter ; in particular I have given (1941) 
the outline of a theory which in my view eliminates the difficulties associated with the 
Irregular Kollektiv. 

Probability and Statistical Distribution 

7.17. Wo now proceed to consider the relationship between the theory of probability 
and that of statistical distributions. Suppose we have a statistical population, finite and 
discontinuous, distributed according to a variate x. If we take a member at random from 
this population the probability that it bears an assigned variate-value is the frequency 
function /(.To), for this is the proportion of members bearing that value. Further, the 
probability that it bears a value less than or equal to is the distribution function F{xo), 
as follows at once from Rule 3 and the definition of tlie distribution function. 

This is the essential link between probabilities and distributions. The distribution 
function gives the probability that a member of the population chosen at random will boar 
a specified value of the variate or less. We must, however, cjonsider whether this statement 
can still be regai*ded as true for populations which are infinite or continuous. 

Suppose in the first instance that the population is infinite and discontinuous. In such 
a case we cannot select a member at random, but we may, in the manner of 7.13, imagine 
a selection from a finite population which tends to the infinite form under consideration. In 
this finite population the proportion of members with values less than or equal to some Xq 
will be F{Xo) and thus, with due regard to the nature of the limiting process, we may still say 
that in the infinite population the probability of a value less than or equal to Xq is F{Xq). 

Similarly for a continuous distribution. In Chapter 1 we considered the continuous 
form as a limiting expression of 

AF =f(x) Ax, / 

If a member is chosen at random from this population in such a way that equal ranges Ax 
are equally probable, the probability that it falls in the range Ax is/(a:) Ax, In the limit* we 
may say that the probability of obtaining a value less than or equal to Xq in taking a member 
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at random from a continuous population is i dF — F{Xo). It must, however, be remem- 

J —00 

bered that the nature of the process to the limit should be specified. 

Hereafter, in speaking of selecting a member at random from a population dF = f{x) dx 
we shall assume that what is meant is a selection random in the limit for intervals dx, i.e, 
such that intervals dx are equally probable. 

The Concept of Random Variable 

7.18. The idea of a variable x which can appear with varying degrees of probability 
dF = f(x) dx has been elevated by mathematicians into a distinct X5oncept, that of a random 
variable. In ordinary analysis no such idea appears. We write “ a variable x ” meaning 
that we are considering propositions about numbers which may be any of a certain range ; 
there is no thought that one of these values is to be considered more frequently than others 
or that it will occur more frequently in practice. The random variable, on the other hand, 
is to be regarded as defined by a distribution function. It may take any values in a given 
range, but the values are distinguished by an associated function. 

7.19. Let 118 consider what is meant by the addition of random variables. In ordinary 
analysis, given two variables x and y, we may define a third variable 

z ^ X y, 

which merely means that when x — Xq and y — z will be Xo + y©. If x and y are random 
variables, can we attach any useful meaning to 2 : ? 

If the joint distribution function of x and y is iFia, we have that the frequency of x < Xq 
and y ^ y© is Fi^ (xq, y^). Consider some value We may then determine from Fi^ the 
frequency such that x y ^ Zq which will, in fact, be the integral 

j (x, y) 

taken over the region for which x y ^ Zo. 

This integral defines a function of Zq which is in fact a distribution function, for it is zero 
at — C30, non-decreasing, and unity at 00 . We may then define this as the distribution 
function of the random variable z and say that 2 ; is the sum of the random variable^ x axad y*. 

7.20. More generally, suppose we have n random variables distributed in the multi¬ 
variate form dF{Xx . . . x„). We may then define a random variable 2 ; by a functional 
equation 

2^ === z(xi . . , xj .(7.11) 

The distribution function of Zo is the integral of dF(xi , , , x^^) over all values oix^ • ^ . x^ 
such that 2;© > z(xx . . . x^). We may regard the equation (7.11) as defining a new random 
variable z with this as its distribution function. 

Sampling Distributions < 

7.21. We have noted that if a member of a population is chosen at random, the 

probability that it will bear a variate-value not greater than x is the distribution function 
F{x). Similarly, if we choose a member from a multivariate population, the probability 
that it will bear a value of the first variate not greater than Xi, of the second not greater 
than , of the nth not greater than is the multivariate distribution function 
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F{Xi^ Xj, . . . .TyJ. Further, if the variates are independent, as defined in 1.33» the rth 
variate being distributed as dF^{x^), this probability is equal to 

F\{Xi) F^{x 2 ) . . . 

Now suppose that we have a selective process, which we will call sampling, applied to 
a univariate population in such a way that it abstracts a group of n members. If this process 
is repeated it will generate a multivariate distribution, each sample exhibiting n values 
Xi . . , The nature of tliis multivariate distribution depends on the sampling process 
as well as the population. If the distribution is 0(xx . . . then this function represents 
the probability that a random sample will result in n values, the first not greater than 
the second not greater than x^, and so on. 

There is one type of sampling process of outstanding importance in statistical theory, 
namely that in which the distribution G{xx . . . x^) is the product of factors 
G 2 (x 2 ) . . G^{x^). In such a case the sampling is said to be simple. The distributions of 

the values Xi . , , are independent one of another, and we may thus say that the selection 
of any member is independent of that of any other. Moreover, if the sampling is random, 
every 0^{x) will he equal to F{x), the distribution function of the population. Thus in this 
case we have, for the distribution of the variate-values in samples of n obtained by a simple 
random method, 

dF{xx . . . — dF(x-i) dF{x2) . . . dF(Xj^) 

‘ ./{xjdx^dx^ . . . dav . . (7.12) 

and^’(^ 2 ) • • • the probability that in such a sample the first value will not 

exceed and so on. Moreover, since the x'a appear symmetrically in (7.12) their order is 
not material. The equation gives the probability that one member of the sample will not 
exceed Xi, another Xz, and so on. 

"^7.22. Suppose now we have a sample of 7t members of the po])ulation witJi variate- 
values a’l . . . We may construct from these values some function, say 

2 = z{xi . . . X,,), .(7.13) 

which might, for example, be the mean or the variance. We may then ask : on certain 
hypotheses as to the way in which the sample was derived, what is the probability that s is 
not greater than some assigned value ? In terms of frequency, if all possible samples 
Xi . . . wore drawn and 2 : computed for each of them, what proportion would fail to 
exceed some value Zq ? 

As an illustration, suppose wc draw a sample of two from the normal population 

1 

dF = ^ e 2 a* dx, 

ay (271) 

Let the sampling be simple and random. Then in virtue of (7.12) the probability of values in 
the ranges centred at Xi and X 2 is 

dP = oxp - + ^1) dx, dxf . . . (7.14) 

Consider now the quantity 

^ ^ + ^2 

What is the probability that z shall be not greater than some assigned Zo ? It is seen to be 
the integral of dP in equation (7.14) over the region such that ^(x^ 1 X,) <z„ i.e. 
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1 fj-o rit,-x, f 1 ■) 

P(z < 2 o) = 2 :^-gj J exp I ~ + ^ 1 ) 

Write 

z = i(-ri + ^s) 

y = — a:*). 

The integral becomes 

“ ">’(“■ L "K" * 

. 

Thus ^" 

P(z„ - |rfZo <2 ' z„ f IdZo) = e~V‘dZo, . . . (7.16) 

a y 71 

a result which, remembering the relation between probability and the distribution function, 
we may express by saying that 2 : is distributed normally with variance ^cr^. The distribution 
function of the statistic 2 : is given by (7.15) and its frequency function by (7.16). 


7,23. In the more general case of a statistic z = z{xx . . . wc see that the prob¬ 
ability of 2 : Zq is obtained by integrating the joint distribution of .Tj . . . over the 
domain of .t’s such that Zq > z(xi . . , x^). This gives us the distribution function of the 
random variable 2 ; defined in terms of the random variables x^ . . . x,, by the equation 
2 : z(xi . . . ,T,^). We shall develop this subject systematically in Chapter 10. 

When the a*-values are chosen by a simple random process the distribution of z is called 
a simjile random sampling distribution, or more shortly a sampling distribution. Unless 
otherwise specified the words “ sampling distribution are always to be taken to refer to 
sampling under simple random conditions. 


Bayes’ 'Pfieorem 

\7.24. We now revert to the theory of probability. Suppose that are 

alternative propositions and let H be the information available, p some additional informa¬ 
tion. Then by Rule 4 


whence 


Thus 


P(q,p I H) = P{p 1 H) P(q, I pH) 
= P(q, I H) P(p ! q^l) 


P(q,\pH) __P{p\q,H) ^ 

P(q, I H) P(p I H) ■ 


P(<?r I pH) 


P{qr I H)J^(p I q^H)^ 
Pip \H) “ • 


(7.17) 


Since the truth of one of the q’s is certain we have, summing for all g’s, 


1 ^Piqr\mPip\qrH) 

^ Pip I H) 


. (7.1B) 
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whence, from (7.17), 

Pkr I VH) 

or, for variations in 


P{q, I H).P{p I g,H) 
EP(q, 1 H) Pip I qrH) 


■ (7.19) 


Piq, I pH) oc Piq, I H) Pip I q,H) .(7.20) 

This is Bayes’ Theorem. It states that the probability of q^. on data p and H is proportional 
to the product of that of q^, on H and p on q^ and H. 

The principal application of the theorem lies in reasoning from observed events to the 
hypothesis which may explain them. The theory of this subject is accordingly known as that 
of ‘1 inverse ” probability. Suppose, in fact, that an event can be explained on the mutually 
exclusive hypotheses • * • {7n ^ he the data known before the event happens, so 

that H is the basis on which we first judge the relative probabilities of the q's. Now suppose 
the event to happen. Then Bayes’ theorem states that the probability of q^. after it has 
happenejd (i.e, on data H and p) varies as the probability before it happened multiplied by the 
probability that it happens on data and H. The probability P{q^ | pH) is therefore called 
t he p os^rior probability, P{qj,[H) the prior probability, and P{p | q^H) will be called the 
likelihood. ' 


In this book the word “ likelihood ” will be used solely in this special sense. 


7,25. The practical use of Bayes’ theorem dejiends on a knowledge of the prior 
probabilities. When they are known we can calculate and compare the posterior prob* 
abilities of the hypotheses, and if we have to choose one in preference to others we choose the 
one with the greatest posterior probability. But we are rarely, if ever, given the prior 
probabilities. And this brings us to what is perhaps the most contentious point in the 
modem theory of probability. 

Bayes stated (though he appears to have felt more hesitation than most of his followers) 
that if there was no known reason for supposing that the prior probabilities were different, 
they were to be assumed equal. This is Bayes’ qyostulafe, which is to be distinguished from 
the theorem of (7.19). It immediately resolves the difficulty of applying the theorem, and 
before discussing the postulate and describing other approaches to the matter, it may be 
u^ful to give two examples of the use of the postulate in practical problems. 


yExample 7.6 

An urn contains four balls, which are known to bo cither (a) all white, or (b) two white 
and two black. A ball is drawn at random and found to be white. What is the proba¬ 
bility that all the balls are white ? 

We have here two hypotheses, qi and On qi the probability of getting a white ball 
is 1, on g'a it is From (7.19) we have 


P(q, I pH) 
P(q.lpH) 


p(^.iH) + mi.iH) 

\P(q. I H) __ 

Piq, 1 H) + iP(^| HY 


Now, in accordance with Bayes’ postulate we assume 


P(q, I H) ^ P{q, I H) = 4 

and find 

Piqt\pH)=^, 

1 pm = 
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^We are thile led to prefer the hypothesie qi that all the balls are white, since this has the 
greater posterior probability. 


/j^xampU 


7.7 


From an urn full of balls of unknown colour a ball is drawn at random and replaced. 
The process is continued m times and a black ball is drawn each time. What is the prob¬ 
ability that if a further ball is drawn it will be black ? 

The question as framed does not admit of a definite answer, for, there being an infinite 
number of possible colours and combinations of colours, we do not know what are the 
hypotheses which are to be compared. Let us suppose that the balls are either black or 
white, and thus consider the hypotheses (1) that all are black, (2) that all but one are black, 
(3) that all but two are black, and so on. The problem still lacks precision, for the number 
of balls is not specified. Suppose there are N balls. We shall later let N tend to infinity to 
got the limiting case. 

Consider the hypothesis that there are R black balls and white ones. The prob- 

R 

ability of choosing a black ball is ^ and that of doing so m times in succession, in virtue of 
/R\m 

1, is . If the ^’s have equal prior probabilities we have, from (7.19), 

^R\^ 


Kul(‘ 4, 


P(q, I pH) - 


(IT 


Ey 


Now th(* probability of getting a further black ball on hypothesis is 


R 

N' 


Since the 


hypotlieses q are mutually exclusive, the probability of getting a further black ball is, in 
virtue of Rules 3 and 4, 


V 

VI R 

Zj N 

B 0 






\m i I 

ff-M) 

I;©'"' 


B 


This is the answer to the limited form of the question. As N —> oo this tends to the quotient 
of definite integrals 

f ^ dx 

Jo * w 4 1 


f 




dx 


in + 2 


This is a particular case of the so-called Succession Rule of Laplace. Enthusiasts have 
applied it indiscriminately in some such xmconditioned form as the statement that if an event 
is observed to happen m times in succession the chances are m + 1 to 1 that it will happen 
again. This is clearly unjustified. 


1.7^ (r The principal difficulties arising out of Bayes’ postulate ajypear from the stand¬ 


point ^ e frequency theory of probability. 


.n. 


If we adopt the axiomatic approach, in which 

K 
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pi?obability is a measure of attitudes of mind, it is reasonable to take prior probabilities to be 
equal when nothing is known to the contrary, for the mind holds them in equal doubt. The 
frequency theory, however, would require the states of events corresponding to the various 
q^s to be distributed with equal frequency in some population from which the actual q has 
emanated, if Bayes’ postulate is to be applied. This has appeared to some statisticians, 
though not to all, to be asking too much of the universe. The postulate is one of the crucial 
points in the theory of probability. Adherents of the axiomatic school accept it. Many of 
those of the frequency school explicitly reject it. 

There is still so much disagreement on this subject that one cannot put forward any set 
of viewpoints as orthodox. One thing, however, is clear—anyone who rejects Bayes’ 
postulate'must put something in its place. The problem which Bayes attempted to solve is 
supremely important in scientific inference and it scarcely seems possible to have any 
scientific thought at all without some solution, however intuitive and however empirical, to 
the problem. We are constantly compelled to assess the degree of credence to be accorded 
to hypotheses on given data ; the struggle for existence, in Thiele’s phrase, compels us to 
consult the oracles. 

The Principle of Maximum Likelihood 

7.27. The school of statisticians which rejects Bayes’ postulate has substituted for it 
an apparently different principle based on the use of likelihood. Reverting to equation (7.19) 
we see that for any and H 

P(<lr I pH) oc P(qr I H) Lip I qjl), .... (7.21) 

where we now write L{p [ q^H) for the likelihood function. The Principle of Maximum 
Likelihood states that when confronted with a choice of hypotheses q we are to sele(‘t that one 
(if it exists) which maximises L{p | In other words, we are to choose the hypothesis 

which gives the greatest probability to the observed event. 

It is to be particularly noted that this is not the same thing as choosing the hypothesis 
with the greatest probability. In fact, some adherents of the frequency theory of probability 
deny any meaning to the expression '' probability of a hypothesis ”, and the principle of 
maximum likelihood was introduced largely to replace the notion of “ inverse ” probability 
which leads to the use of such a phrase. 

7.28. Suppose (as is nearly always the case in statistical work) that the hypotheses 
with which we are concerned assert something about the numerical value of a parameter 0. 
In such a case we shall speak of a statistical hypothesis. For instance, the hypotheses might 
he qi 0 < 0, q 2 . ^ 0 > 0, in which case there are two alternatives. Or wo might have 

0 ==-1, q^ -0 = 2, and so on, in which case there is a denumerable infinity of 
hypotheses. 

If now d can have only discontinuous values, we may, confronted with an observed 
event jo, require to estimate 0, or to ask what is the “ best ” value of 6 to take on the evidence 
p. The method of Bayes would state that the best ” value was the most probable value. 
In (7.21) we should seek for that q^ which made P(q^ | pH) a maximum. If we know nothing 
of the prior probabilities P(^^ [ H) we should, in accordance with Bayes’ postulate, assume 
all such probabilities equal. We then merely have to find that q^ which maximises L(p | q^H), 
In other words, the postulate of Bayes and the principle of maximum likelihood result in the 
same answer and are equivalent. 
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7.29. This position apparently does not hold if the permissible values of 0 are continu¬ 
ous. We must now replace such expressions as P(q^ j H) by P{d^--j^dOo <d<do -f |ri0o 1 H) 
and in place of (7.21) we get 

P(@o -idOo <e <$0 + ido, I pH) oc P{e, ^ e < e, + \de, | h) 

X L{p I 00 - Idd, 0 ' 00 H |d0o, //). , . (7.22) 

If we now require the “ best ” value of 0, we should, in accordance with Bayes’ postulate, 
take the prior probability to be a constant and once again we should have to maximise L for 
variations of 0. 

We might, however, have chosen to represent our hypotheses, not by 0, but by some 
variate ^ functionally related to 0, e.g. the standard deviation instead of the variance. In 
this case we should have reached equation (7.22) with written everywhere instead of 0 ; 
we should have taken the prior probability as constant ; and we should have arrived at 
the conclusion that we should maximise L for variations of (jy. 

But are we being consistent in so doing ? If we assume that the elementary intervals 
of 0 are equiprobable we cannot assume the same of <^, and thus the use of Bayes’ postulate 
appears to involve self-contradiction. The principle of maximum likelihood is free from 
this difliculty, for if L{0) is to be maximised for variations of 0 it will, at the same time, be 
maximised for variations of (f>, since 

dL _ dL 
00 ”■ 00 

and the two sidos of this equation vanish together. 


7.30. This is one of the grounds on which adherents of the frequency school have 
rejected Bayes’ postulate in favour ol the principle of maximum likelihood ; but in rny view 
the matter has been misunderstood. It would seem that Bayes’ postulate and the principle 
give the same answer in the continuous case as well as in the discontinuous case when proper 
regard is had to the limiting processes involved. We saw in 7.13 that in sp(*aking of 
probability in a continuum it was essential to specify the nature of the process to the limit. 
If we regard 0 (from the frequency view|)oint) as having emanated from a population by 
a process random in the limit for intervals dO, then Bayes’ postulate applied to this process 
will clearly give a different answer from that obtained by supposing that 0 emanated by 

d<l> 


a process random in the limit for d<f) 




The tw^o are different just as the prob¬ 


abilities in Example 7.5 are different, and for the same reason. Thus the apx>arent incon¬ 
sistency is not an inconsistency at all, but a difficulty introduced by ignoring the limiting 
process in continuous populations.* 

For an extended discussion of this subject reference may be made to Kendall (1940). 
In the present volume it need not concern us to take it farther, though considerable use will 
be made of the principle of maximum likelihood in Volume 2. It will there be seen that the 
principle has many important statistical properties. No one, in fact, denies the importance 


* A further difficulty arises if 6 can ho in an infinite range, for then Bayes’ postulate apparently 
leads to tho conclusion that prior probabihties in any finite range are zero and hence so are posterior 
probabilities. This does not arise in the likelihood method. Jeffreys overcomes it by assuming that the 
prior probabiUty in such a case is inversely proportional to the parameter 6. Looking at the problem 
generally, we need not be surprised that the difficulty appears since the ranging of 0 over an infinite 
range is also a limiting process. In practice we are never so ignorant a priori as to suppose that 6 can 
be any value however largo with tho same probability, and if we consider the range os deterimnate 
but unknown, likelihood and liayes’ postulate continue to be applicable and to give tho same results. 
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of the principle or its usefulness in certain cases ; the controversy hitherto has oentied on 
the considerations by which the acceptance of the principle as a rule of conduct is to be justi* 
fied. The reader who cannot accept Bayes’ postulate and the foregoing argument that it is 
virtually identical with the principle has a choice of courses. He can accept the principle 
as a new and distinct postulate of scientific inference ; he can regard it as justified by its 
mathematical and statistical properties ; or he can rely on a more sophisticated approach 
which will be touched on in Chapter 9, namely, that the principle leads to estimates of 
parameters with minimum sampling variance when such exist. At this stage he may be 
prepared to accept it on intuitive grounds.’^ 

7.31. Although in the remainder of the present volume Bayes’ postulate and the 
principle of maximum likelihood will not often appear explicitly, we shall frequently use 
a type of argument which is, in the ultimate analysis, based on them. A certain event or 
series of events is observed ; on a hypothesis H the occurrence of these events is found to be 
highly improbable ; and therefore H is rejected in favour of some hypothesis which makes 
the observations more probable. To take a very simple example, we toss a penny twenty 
times and find that it comes down heads every time. If the penny were unbiased 
(hypothesis H) the odds against this event would be 22® — 1 to 1. Thus we reject H in 
favour of the hypothesis that it is in fact biased in favour of the heads. 

It will readily be seen that this type of argument is a somewhat indefinite form of the 
inverse type with which we have been concerned. The chief difference lies in the fact that 
it is used to reject unlikely hypotheses rather than to accept the most likely, possibly a safer 
but certainly a less precise procedure. 


The Central Limit Theorem 


7,32. To conclude this chapter we prove an important theorem which gives the normal 
distribution a central place in the theory of probability and the theory of sampling. It has 
already been shown that the distribution appears as the limiting form of the binomial and 
the Pearson Type III distribution when expressed in standard measure. We shall prove 
a much more general result, due to Laplace but first proved rigorously by Liapounoff, that 
under certain conditions the sum of n independent random variables distributed in whatever 
form tends, when expressed in standard measure, to the normal form as n tends to infinity. 
This is the famous Central Limit Theorem. 

Let us note in the first place a simple but powerful result connected with the character¬ 
istic functions of sums of independent random variables. If we have n such variables 
distributed as dF^ . . . the element of frequency of their sum z ~ + . . . is the 

integral of dFy . . . dF^^ through the element of volume between z and z dz. Thus the 
characteristic function of their sum, being the integral of through the range of z, is equal to 


r 


^<30 ^OO 

... . . .dF^ 

J — O) J —00 

ao 

c<tei dFt • • . 1 dFn 

— oo J —oo 


dF^ 


— . . . (f>^. 


♦ An approach of a rather different kind has been developed in recent years by Neyman (1937), 
who bases his theory of inference only on direct probabilities. An account of this theory will be given 
ip the second volume. 
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That is to say, the charaoteristio function of the suijq of a number of independent random 
variables is the product of their characteriatic functions. The cumulative function is 
accordingly the sum of their cumulative functions. 

Now as to the Central Limit Theorem itself. We first of all outline the proof briefly 
and unrigorously to indicate its essential features, and then give a rigorous proof. Suppose 
we have distributions Fx . 
functions We have for any 


F^, all with finite second moments and with characteristic 


^r(<) 




when jB is a remainder term. Similarly we have 

V’r(<) 

Hence the cumulative function of the sum of the independent variates will be 

W{t) 




f < + ER. 


We can without loss of generality take the mean of the sum as origin, so that = 0, and 


now transforming to standard measure by the transformation $ 


m 


— /2 
- 21 “ 


(---)■ 


find 

V 27/i2 


Since Z’/./g is of order u 
tends to zero. We shall then have 


n 


the remainder term will be of order i e. of order ; and thus 


Urn W{t) = ~ 




e 2 


lim 0(t) 

and hence in virtue of the converse of the First Limit Theorem (4.12) the distribution of 
the sum of the random variables tends to normality. 


7.33. The rigorous enunciation of the theorem and its proof are as follo^v8 :— 

If n independent random variables are distributed in the forms Fi . . . F,^ with finite 

n 

variances i . . . jUi ^ and then the sum of the variables divided by \/M^ 

tends to the normal form, provided that for any e > 0 

lim J Y'f x^dF^^O .(7.23) 

n—>-00 n J 

The implications of this condition, which is a modification by Cramer of one due to 
Lindeberg, are not very obvious, but it involves that 

oo and ^^-^0 .(7.24) 

in other words, that the total variance tends to infinity but that the proportional contribution 
of each constituent tends to zero. To see that (7.24) follows from (7.23) we note that if 
does not tend to infinity it must, being an increasing function, tend to a constant. It would 
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follow from (7.23) that the sum of the integrals, each of which is positive and not small for 
every e, would tend to zero, which is impossible. Further, if did not tend to zero, then 
at least one of the terms in (7.23) would not do so, and thus the sum would not do so. 
We have 


= f -f f dFj. 


Expanding the exponential with a Maclaurin remainder we have 


-I- 




f 

(i + J'* + 



J 4| "'f v/JI /m 

\ V-^n 

231 n > 

1 ^ 

f 

6 i 1 

A VM„ 


-f d' 

without 

loss of generality suppose 

==1 - r 




2 

3f„ ^ 23f„ J 

iul' eVMn 



f 

P 1 


Oil/,, . 

]\,\<eVM„ 

1 


0\A0'\ <; 1. 


0 ^'|0|, l&'l <1. 


Thus for some T 1 we have, for | < | < T, remembering that 

.»=* dF 




I 


xMF, 


') 


0 < 1 0' 


f \x^\dF t^/mA 

J |J <WM„ ' J 

J M^\ J[j,| ex/Jir„ 

Hence, in virtue of (7.24) the coefficient of 0" is as small as we jdease and thus <f), 
tends to unity as ii oo uniformly for | ^ | T. Thus wc have 

VA 


1 . 




for sufficiently large )t and \ tj \ t. Thus for t -' i 

” i 4 

2 M,, M, 

Summing for j we have, in virtue of (7.23) 

- 


{v'M-) 

I have, 


Um) - 0 ' ''Hvm-) ~ '} 

for t - ' I, 

: a >-\ 


xMF. 


\ 




-f 2d"T^e A vanishing quantity) 


and th\is for \ t 


lim 'f'f A \ = : J_*, 

W^J 2 


the convergence being uniform in any finite ^interval. The theorem follows from the con¬ 
verse of the First Limit Theorem. 
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7,34. The following comments will amplify the above proof, 

(a) The Lindeberg condition (7.23) is necessary as well as sufficient. A proof is given by 
Cram6r (1937). 

(b) The condition may be put in other forms, for which see Cramer (1937), Uspensky 
(1937) and the original memoir by LiapounofF (1901). 

(r) The sum of random variables whose distributions have not a finite second moment 
may not tend to normality. It will be seen in Chapter 9 that the mean of variables each of 
which is distributed in the form 


dF - 


k dx 
I 


00 < a; < 00 


is also distributed in that form, however large n may be. 

{d) LiapounofF has also given some remarkable results showing how close the limiting 
form is to the sum of n variables. In fact, if is the distribution function of the sum, 
and F that of the normal form 




F 
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where < is a constant, is a function of the third moments of the constituent distributions. 
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EXERCISER 


7.1. If each of an aggregate of N objects can possess or not possess any of n character¬ 
istics A, B, ,,, K , and if {ab , . . /) is the number of objects possessing A, B , , , F, 
show that the number of objects possessing at least one of A, JS, ... A is 


E{a) — E(ah) + E{abc) ... + (— iy^~\E{ab , , , k). 

In each of a packet of cigarettes there is one of a set of cards numbered from 1 to w. 
If a number N of packets is bought at random, the population of packets is large and the 
numbers are equally frequent, show that the probability of getting a complete set of cards is 






7.2. Three points are taken at random on a circle. Show that the probability that 
they lie on the same semi-cirple is J. (Assume that in the limit elementary intervals of arc 
are equiprobable.) 

Explain the fallacy in the following argument: One pair of the points must 
lie on a semicircle terminating at one of them. The probability that the third point lies 
on this semicircle is J, which is therefore the required answer. 


7.3. A simple random sample of n values, , x^, is drawn from the normal 

population 

dF = e-^y-T) dx. 

0^271 
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Show that the value of m which maximises the likelihood of this event is 



which is therefore the “ best ” estimate of the mean of the population. 

7.4. Show that if p is the probability of a zero in the Irregular Kollektiv the prob¬ 
ability that there will be r consecutive zeros in a set of n members chosen at random obeys 
the recurrence relation 


and hence that 


f (1 - “ P) 


V 


n, r 


= 1 - V,, ,. 

Ki] , . , 

X '>*(« - 


where 



CHAPTER 8 

RANDOM SAMPLING 


The Sampling Problem 

8.1. In the previous chapter we have referred incidentally to the sampling problem, 
which can be stated quite simply : given a sample from a population, to determine from it 
the properties of that population. We noted that only in exceptional cases is it possible to 
make assertions about the population with complete certainty, and that consequently it is 
necessary to fall back on statements of a less categorical kind expressible in terms of prob¬ 
ability. 


8.2. In order to be able to apply the theory of probability to this problem it is necessary 
that the sampling should be random. In actual practice we often meet with samples which 
are not random, having been chosen purposively for some reason or other. In such circum¬ 
stances it is not, as a rule, possible even to make precise statements in y)robability ; and where 
a decision has to be taken one is forced to rely on subjective judgments of an unsatisfactory 
kind. No numerical estimate of the probabilities can be made. It is for this reason that 
random sampling becomes of primary importance in statistical investigations from sample 
to population. From this point onwards we shall deal only with random samples, and to 
avoid constant repetition shall leave it to be understood that where a “ sample ” or 
a ** sampling distribution ” is referred to, random conditions are assumed. 

8.3. It is useful to begin a discussion of random sampling by considering the types of 
parent population from which samples can be chosen. 

{a) In the first place, the population may be finite and existent, e.g. the population of 
human beings in Europe at a fixed point of time, or the population of apples on a given 
tree. A sampling process which extracts members one at a time from this population 
wiU evidently eventually exhaust the supply of members if continued long enough. Thus 
the sampling, though random, is not simple in the sense of 7.21, for the probability of 
a given member being chosen varies according to what has already been abstracted. 

We may, however, reduce this process to one of simple sampling by replacing the 
members after withdrawal. The population then remains the same at each trial. The two 
cases arc sometimes distinguished as “ sampling without replacement ” and “ sampling with 
replacement 

Furthermore, we may also in many cases regard the sampling as simple to an adequate 
approximation even when there is no replacement. If the population is large compared with 
the size of the sample, the abstraction of relatively few members will not materially affect the 
constitution of the remaining population, which may thus be regarded as approximately the 
same for subsequent samplings. 

(b) Sampling with replacement from a finite population may, in fact, be regarded as 
sampling from an infinite population, for the process will never exhaust the supply. We 
may, however, have to deal with a population which is infinite in rather a different sense, 
namely, that of a limiting form. We may, for example, wish to consider the probability of 
a sample from the positive integers or the real numbers from 0 to 1. The latter case presents 
itself in sainpling from a continuous frequency-distribution which we must necessarily regard 
as infinite. 
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Thus, if we replace an observational distribution by a conceptual continuous mathe¬ 
matical distribution, we replace at the same time a finite population by an infinite population. 
The drawing of random samples from such a population is attended by the circumstances 
refeiTed to in 7,13 and 7.29, namely, that the process to the limit must be taken into account. 

(r) Thirdly, the population may be purely hypothetical. Consider, for example, the 
throws of a die. We may picture the continual throwing as a sampling process drawing 
existent members from some non-existent population. In such cases what we are really 
doing is constructing by mental fiction an imaginary population round the sample. 

The concept of the hypothetical population is necessitated by ideas of frequency in 
probability. It is not required (and indeed has been explicitly rejected by Jeffreys) in the 
approach which takes probability as an undefinable measurement of attitudes of doubt. 
But if we take probability as a relative frequency, then to speak of the probability of a sample 
such as that given by throwing a die or growing wheat on a plot of soil we must consider the 
sample against tlie background of a population. There are obvious logical difficulties in 
regarding such a sample as a selection—it is a selection without a choice—and still greater 
difficulties about supposing the selection to be random ; for to do so we must try to imagine 
that all the other members of the population, themselves imaginary, had an ecpial probability 
of assuming the mantle of reality, and that in some way the actual event was chosen to do so. 
This is, to me at all events, a most baffling conception. At the same time, it has to be 
admitted that certain events such as dice-throwing do happen as if the constituents were 
chosen at random from an existent population, and it accordingly seems that the concept of 
the hypothetical population can be justified empirically. 

}iand())nness in Samplivg 

8.4. In its colloquial use the word “ random ” is applied to any method of choice 
w^hich lacks aim or purpose. We speak of drawing names at random out of a hat, choosing 
plants at random from a field of com, selecting family budgets at random from the popula¬ 
tion, meaning thereby that the selection is completely haphazard. 

Now it is found in practice that choice by a human being is not random in the stricter 
sense that it produces equally frequently events which we are entitled to exjiect to have 
equal prior probabilities. Some examples will make this clear. 

Example 8,1 

In the course of certain work at the Rothamsted Experimental Station sets of eight 
wheat plants were chosen for measurement. Six of these were chosen by approved methods, 


TABLE 8.1 

Diatrihutim of Plants chosen haphazardly in Rallies 1 to 8. 
(F. Yates, Ann, Eugen, Lond,y 6, 202.) 


Date. 


May 31st 
June 28th 


Observation. 


Shoot height 
Ear height 


Numbers bearing Specified Rank. 

2 1 3 


I 


7 

19 


11 

27 


4 

6 

6 

7 

8 

Total. 

8 

11 

18 

21 

1 

31 

116 

23 

15 1 

i 

10 

5 

4 I 

1 

112 
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referred to below, and may be taken to be truly random. The other two were chosen 
haphamrdly by eye. If, in any set, the eight plants were ranged in order of magnitude, the 
two selected by eye could have any number from one to eight; and if they, in common with 
the other six, were chosen at random, they should occupy these places ivith approximately 
equal frequency in a large number of sets. Table S.l shows what actually occurred on two 
diflFerent occasions (a) on May Slst, before the ears of wheat had formed, and (6) on June 28th, 
after the ears had formed. 

The divergence of actual from expected results is quite striking. On May 31st, before 
the ears had formed, the observer was strongly biased towards the taller shoots ; whereas in 
June he was biased strongly towards the central plants and avoided short and tall plants. 

Thus it is seen that bias can appear even in a trained observer, and that the bias need 
not be consistent in over- or under-estimation in dilferent circumstances. 

Example 8.2 

The following table shows the fi’equencies of final digits in a number of measurements 
made by four different observers:— 


TABLE 8.2 

Bias in Scale Reading. Distribution of Final Digits in Measurements by 

Four Observers. 

(G, U. Yule, J,R. Statist. Soc.. 90, 570.) 


Final Froquenry of Final Digit pen* 1000. 



A 

1 B 

i C 

D 

0 

158 

' 122 1 

251 

358 

1 

97 

98 

37 

49 

2 

125 

98 

80 

90 

3 

73 

90 

72 

1 63 

4 

76 

100 

55 

I 37 

6 

71 

112 

1 222 

1 211 

« 

90 

98 

71 I 

62 

7 

56 

99 

75 

70 

8 

126 

101 

72 * 

44 

9 

129 

81 

65 

1 

16 


1001 

999 

1 

1 1000 

1 

i 

1000 


It is hard to suppose that there was any genuine difference which would lead to the 
appearance of certain digits at the expense of others, and we may confidently suppose that 
the deviations from approximate equality indicate bias on the part of the observer. 

Observer A had decided preference for 0, 2, 8 and 9, avoiding the centre of the scale. 
Observer B is quite good, his deviations from expected values being small, though he also 
showed some preference for 0. Observer C was poor, rounding off one measurement in two 
to the whole or half unit. Observer D was obviously very bad indeed, nearly 67 per cent, of 
his measurements being rounded off to the whole or half unit. 

The observations were all made by reading a scale, those under A being on drawings to 
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the nearest tenth of a millimetre, those under B, C, and D being measurements on the heads 
of living subjects to the nearest millimetro. We may conclude from this that different 
observers may exhibit different degrees of bias even under comparable circumstances, and 
that even those who are aware of the existence of the possibility of bias and the necessity for 
taking great care (as observer A was) may nevertheless fail to avoid it. 

Example 8.3 

An observer was placed before a machine consisting of a circular disc divided into ten 
equal sections in which were inscribed the digits 0 to 9. The disc rotated at high speed and 
every now and then a flash occurred from a nearby electric lanip of such short duration that 
the ^sc appeared at rest. The observer had to watch the disc and write down the number 
occurring in the division indicated by a fixed pointer. 

This was a machine designed for the provision of truly random numbers (see below, 8 . 10 ) 
and had been found by another observer to do so. But this particular observer produced 
a definite bias. The frequencies of digits in 10,000 mn off by him are shown in Table 8.3. 

TABLE 8.3 


Distribution of Digits obtained by an Observer in using a Randomising Machine. 
(Kendall and Babington Smith, Supp, J.R. Statist. Soc.^ 6 , 51.) 


Digit. 

0 

1 

2 1 

3 

1 

4 ! 

i 


6 

7 

( 

« 1 

1 

9 

1 Total. 

1 

1 Frequency 

1 

1083 

1 865 

i 

1053 1 

884 

1 

j 1067 j 

1007 

1081 1 

L ^ ‘ 

997 

1025 j 

948 

! 

j 10,000 


If the observer was unbiased the digits should appear in approximately equal numbers ; 
but there is a bias in favour of all the even numbers and against the odd numbers 1, 3 and 9. 
The cause of this bias is obscure, for the observer did not have to estimate (as in the previous 
example) but merely to write down something wliich he saw, or thought he saw. The 
explanation seemed to be that ho had a strong number-preference, i.e. that he actually mis- 
saw the numbers, or that his brain controlled his ocular impressions and censored them. We 
have here to deal with one of the deadliest fonns of bias in psychology. 

Example 8.4 

Every year a number of crop reporters in England and Wales estimate the prospective 
yields of certain crops, forecasts being obtained at different periods of the year and final 
estimates when the crop is harvested. Table 8,4 shows the average estimated yield of 
potatoes at the various times for the years 1929'-1936. 

This table exhibits very clearly an effect which has shown itself in nearly all the English 
crop reports (and appears also in other countries), namely, the chronic pessimism of crop 
forecasts. In every case but one in the above table the forecasts are below the final yield. 
Nor do crop reporters seem able to learn by experience that they are underestimating. 
Nothing in this table indicates that the differences between forecast and final estimate 
diminished during the period concerned. 

It should also be noticed that these estimates are the weighted average of a large number 
of independent observations. One of the commoner misunderstandings in this type of work 
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TABLE 8.4 


Bias in Crop Forecasting. Forecasts of Yields of Potatoes in England 
and Wales {Tons per Acre). 

(From the official agricultural statistics.) 



Sept. 1st. 

Oef. Ibt. 


Nov. l.st. 


Year. 


- - 





Final 


Yield. 

% Diffoiotico 
from Final. 

Yield. 

% Differonco 
from Final. 

Yield 

Dxrfereiico 
from Final. 

Kstimate. 

1929 

5*7 

17-4 

6*2 

- 10*1 

6*5 

- 5*8 

0.9 ' 

19.30 

0*0 

- 7*7 

61 

- 6-2 

I 6*1 

“ 6*2 

<i.r> 

1931 

5-5 

00 

5-3 

--3 6 

5*3 

- 3 6 

ri.n 

! 

1932 

0-4 

~ 3*0 

6 2 

6 1 

6*3 

- 4*5 

6-6 ' 

1933 

0-4 

- 4-5 

6*2 

- 7-.5 1 

1 6*4 

1 - 4*5 

6*7 , 

1934 

6 0 

~ 15-5 

6*3 

n-3 

6*7 

- 5 (> 

7 1 1 

1935 

5-6 

- 9*7 

5*7 

- 81 

6*0 

' - 3 2 

6-2 

1930 

6-0 

- 3-2 

5*9 

, - 

5*8 

- 6*5 

6*2 


_ 

1 
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is based on the supposition that, though individuals may make mistakes, their errors will 
cancel out in the aggregate. Our present example shows this to be untrue in general. 
There can appear a systematic bias affecting all the individuals performing estitnates. 

8 . 5 . The foregoing examples are enough to indicate that human bias is very prevalent* 
Trained observers may be biased even when conscious of their own imperfections ; different 
observers may be biased in different ways in similar circumstances ; and the same observer 
may be biased in different ways in different circumstances. It is abundantly clear that we 
must look for true randomness elsewhere than in mere lack of purpose on the part of human 
observers. There may be persons wdiose psychological processes are so finely balanced that 
they can deliberately select random samplers, but few statisticians who have experimented in 
this interesting field would regard themselves as among them. 

8.6. In Chapter 7 we saw that the primary function of randomness in probability was 
that it ensured that certain primitive events were equally probable. We may say that 
a method of selection is random for a population U if, when applied to U, it gives all members 
an equal probability of being chosen ; or, in the language of frequency, if, when continually 
applied to U, it educes the members approximately equally frequently. 

But this is not enough. Suppose we had a population of two members A and B, and 
sampled with replacement. Then a method which chooses A and B alternately and produces 
the series ABAB . . . educes each member approximately equally frequently ; but it is 
not what we customarily mean by a random method. What we require of a random method 
is that in such circumstances it should produce a series like that of von Mises ( 7 . 15 ) in which 
no systematic arrangement is evident. Not only single characteristics, but all possible 
groups of characteristics should appear equally frequently. 

8 . 7 . A further point is to be noted. We may, in drawing the sample, be interested in 
one particular variate exhibited by the members, and it is possible that a method may give 
a satisfactory random sample so far as this variate is concerned without doing so for other 
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variates. Suppose, for example, we are anxious to take a random sample from the 
inhabitants of a particular street. If we are concerned with a variate such as eye-colour it 
might be sufficient to choose a house every so often, say every tenth house, and take the 
inhabitants of that house as part of the sample. Such a method would not give every 
inhabitant an equal chance of being chosen ; but if we look back to the time when the 
inhabitants took up residence we may imagine that the colour of their eyes did not influence 
their geographical distribution, and thus that if we consider the allocation of the inhabitants 
in some way independent of eye-colour, and then take every tenth house, we may suppose 
that so far as eye-colour is concerned the sample is random. But the matter would stand 
difterently if we were samplmg for income. If for instance every tenth house was a corner 
house and thus inhabited by a person of more than average income, our sample would no 
longer bo random with respect to income. Looking back, as before, to the time when 
inhabitants took up residence, we see that they can no longer be regardt^d as distributed at 
random, for those with larger mcomes will tend to be attracted towards tlie more expensive 
houses. 

Thus a method which is random for one population may not bo so for another ; and even 
in tli(' same population a method random for one variate may not be so for another. 
Randomness is relative. 

The T'echnique of Random Sampling 

8.8. Suppose^ then, that we arc given a population and a variate is specified. How^ are 
we to draw a random sample, i.e. how can we find a method which is random for that popula¬ 
tion and that variate ? The answer lies partly in theory and partly in practice. 

{a) In the first place we must recpiire that there is no obvious connection between the 
method of seJcction and the properties under consideration. Tiie method and the properties 
must be independent so far as our prior knowledge is concerned. In sampling a field of 
wheat for shoot height, for example, we must not tise a method which could be influenced by 
that height, such as skimming a hoop over the field and selecting the plants round which it 
fell (for the hoop might tend to catch on the taller plants). Again, in sampling the 
inhabitants of a town by choosing names from a telephone directory we should undoubtedly 
tend to got the more well-to-do classes and hence, if the variate under consideration is wealth 
or any related characteristic such as number of children, political opinion, standard of 
education and so on, the sample would not bo random. If we were concerned with character¬ 
istics sxich as height, hair colour, or blood group the sample might b(i random, though it is 
not difficult in many similar cases to think of reasons why the variate might bo linked with 
wealth. 

If this matter is viewed from the standpoint of the axiomatic theory of probability the 
absence of knowledge about relationship between the method and the characteristic under 
consideration may be sufficient to ensure randomness, for the probabilities of elementary 
propositions then become equal—the probabilities being measures of prior attitudes of mind.* 
But if the frequency viewpoint is adopted it is not enough that there should be absence of 
knowledge of this kind, for unknown to the observer there may be relations which will prevent 
the elementary propositions from being true in approximately equal proportions. The 
presumption is that if we make as great an effort as possible to ascertain whether any relation¬ 
ship exists and fail to find it, there is no relationship ; and hence we can assume randomness 

* At least, this is my interpretation of the position ; but the writers on the axiomatic theory have 
not discussed randomness at any length, being content to define it in terms of probability, and 1 may 
bo putting a gloss on thoir views which they would not accept. 
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wiih m<>re or less confidence. But in this approach the assumption of randomness is 
ultimately part of the general uncertainty of the inference from sample to population* 

(6) Secondly, we may rely on previous experience of a random method to justify its use 
on new occasions. This is evidently an extrapolation, and though most people would regard 
it as reasonable, the fact has to be realised. The axiomatic theory of probability can embrace 
this extrapolation within its scope, for the probabilities given by the method are assessable 
in terms of prior knowledge ; but the frequency theory has to take the extrapolation as an 
additional assumption. 

8 . 9 . One of the most reliable methods of drawing random samples consists of construct¬ 
ing a model of the population and sampling from the model. We may, for instance, note 
down the characteristics of each member on a card and sample by choosing cards from the 
pack corresponding to the whole population. This is the method adopted in lotteries and 
the process is known as lottery or ticket sampling. It is moderately effective but suffers in 
practice from two disadvantages: the labour of constructing the card population, and the 
danger of bias in the drawing of cards. Example 12.1 below, for instance, shows that the 
ordinary processes of shuffling and dealing playing-cards may fail to be satisfactory. To be 
reasonably satisfied about the randomness of the shuffling entails a good deal of trouble and 
labour, and the same object can be attained much more simply by the use of random sampling 
numbers, which we now consider. 

Random Sampling Numbers 

8 . 10 . The easiest way of constructing a miniature population is to attach an ordinal 
number to each member, mostly simply by numbering the members from 1 onwards. The 
set of ordinals so obtained is the miniature population and the jjroblem of drawing a random 
sample reduces to finding a series of random numbers. The advantages of this method are 
obvious : no physical model population has to be constructed ; the numbering can be carried 
out in any convenient manner ; and the series of random numbers can be applied to any 
enumerable population so that any series of random numbers has a very wide range of 
application. 

One point should be made clear here. If the numbering of the population is carried out 
in such a way as to be independent of certain characteristics of the population, any set of 
numbers will serve to draw a sample random with respect to those characteristics. The 
randomness in such a cose lies, so to speak, in the allocation of ordinals to the population, 
not in deciding which ordinals to select for the sample. But in practice a procedure of this 
kind is of no value, since it only throws back to the difficulty of numbering the population 
‘‘ at random The usual course is to number the population in any convenient way, related 
to the characteristics or not, and then seek for a set of numbers which are a random set from 
the possible ordinals of the population. 

8 . 11 . One of the more obvious ways of drawing random samples from an enumerated 
population is to use haphazard numbers taken from some totally unrelated source. Suppose, 
for instance, we wished to take a sample from the visible stars in the sky. We will ignore the 
small complications duo to the existence of double stars and unresolved objects. Since the 
position of a star on the celestial sphere is defined by latitude and longitude, what is then 
required is a series of random pairs of latitudes and longitudes. At first sight it seems 
plausible to take an ordinary atlas and choose the figures set out in the index for place-names 
arranged alphabetically ; for there is little reason to expect any relationship between the 
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distribution of stars in the sky and tho distribution of places oil the Earth’s surface. A little 
reflection, however, will show that the method is unsound. There are large stretches of 
territory and sea on the Earth which have no place-names on them—the poles, deserts and 
oceans ; consequently no numbers will occur for these regions and there will be corresponding 
areas on the celestial sphere which have no chance of being included. 

8 . 12 . As a next attempt we might take a book containing a number of digits, e.g. 
a telephone directory, or a set of statistical tables or mathematical tables, open it at hazard 
and choose the digits which first strike the eye, or which occur at the top of the page, and so 
on. This is an improvement, but it is still open to some objection. 

(a) Telephone directories. Table 1.4 on page 6 shows the distribution of 10,000 digits 
taken from the London telephone directory. Pages were chosen by opening the directory 
haphazardly, numbers of less than four digits and numbers in heavy type were ignored ; and 
of the four-figure numbers remaining the two right-hand ones were taken for all numbers on 
the page. If the numbers were random we should expect about 1000 of each digit in the total 
of 10,000. Actually there are very considerable deviations from this expectation, and we shall 
see in a later chapter that they cannot be explained as sampling fluctuations. There are 
significant deficiencies in 5’s and O’s, due to several causes such as the tendency to avoid 
these digits because they sound alike, the reservation of numbers ending in 99 for testing 
purf)oses bv telephone engineers and so on. It is evident that tables of random numbers 
could not be constructed from directories such as this. 

{()) Mathematical tables. Evidently care has to be exercised in using mathematical 
tables in constructing random series. Suppose, for instance, we take a set of logarithm 
tables. There are clearly relationships between successive logarithms, expressible by the 
fact that differences are approximately constant if the interval is small. Moreover there is 
a very curious theorem about digits in certain classes of table which throws theoretical doubt 
on the method. Consider the logarithms to base 10 of the natural numbers from 1 onwards. 
vSuppose we choose the kth digit in each and so obtain a series of numbers 0-9. Then the 
proportional frequency of any digit in this series does not tend to a limit as the length of the 
series increases, whatever k may be.* Just what does happen does not appear to be known, 
but it would seem that certain systematic effects begin to show themselves and those will 
obviously endanger the randomness of the series. 

(r) Statistical tables. If we have a volume of statistics such as populations of towns 
and rui al districts there are some grounds for supposing that if the numbers are large—say 
four figures or more—the final digits will be random. Here again, however, the use of such 
tables requires care—they may have been compiled by an observer with number preferences, 
and some rounding up may have taken place. 

8.13. However, the necessity for the ordinary student to construct random series of 
his own has been obviated by the publication of various tables of Random Sampling Numbers, 
There are three such available :— 

(а) Tippett’s numbers comprise 41,600 digits taken from census reports combined into 
fours to make 10,400 four-figure numbers {Tracts for ComputerSy No. 15). 

(б) Kendall and Babington Smith’s numbers comprise 100,000 digits grouped in twos 
and fours and in 100 separate thousands {Tracts for CornputerSy No. 24). These numbers wore 

* Cf. J. Fanel, Vierteljahrschrift der Naturforackenden Oeadlachaft in Zurich (1917), 62, 286. So 
great a xiiathematioian. as Poincjar^ mad© a mistake on this point. 
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obtained from a machine specially constructed for the purpose on the lines very briefly 
described in Example 8.3. 

(c) Fisher and Yates’ numbers comprise 15,000 digits arranged in twos {Statistical Tables 
for Biological, Agricultural and Medical Research). These numbers were obtained fronl the 
15th-19th digits in A. J. Thompson’s tables of logarithms and were subsequently adjusted, 
it having been foimd that there were too many sixes. 

Before considering the basis of these tables it may be helpful to give some examples of 
their use. Here are the first 200 of the Kendall-Babington Smith tables :— 

TABLE 8.5 


Random Sampling Numbers. 
(Tracts for Computers, No. 24.) 


23 

16 

76 

48 

69 

01 

83 

72 

69 

93 

76 

24 

97 

08 

86 

96 

23 

03 

67 

44 

06 

54 

66 

50 

43 

10 

63 

74 

35 

08 

90 

61 

18 

37 

44 

10 

96 

22 

13 

43 

14 

87 

16 

03 

60 

32 

40 

43 

62 

23 

50 

06 

10 

03 

22 

11 

64 

38 

08 

34 

38 

97 

67 

49 

61 

94 

05 

17 

68 

63 

78 

80 

69 

01 

94 

32 

42 

87 

16 

95 

97 

31 

26 

17 

18 

99 

75 

63 

08 

70 

94 

26 

12 

68 

41 

64 

88 

21 

06 

13 


Example 8.5 

To draw a sample of 10 men from the population of 8585 men of Table 1.7. 

The first process is to number the population ; and here, as in most similar cases, one 
numbering has already been provided by the frequency-distribution. We take numbers 
1 and 2 to be those in the group 57- inches, numbers 3 to 6 those in the grouj) 58-, and so on, 
those in the group 77- inches being numbers 8584 and 8585. 

Now we take 10 four-figure numbers from the tables, e.g, reading across in Table 8.5 
we have 

2315, 7548, 5901, 8372, 5993, 7624, [0708], [8695], 2303, 6744, 0554, 5550. 

The two numbers in square brackets are greater than 8585 and we ignore them. We 
now select the individuals corresponding to the remaining 10 numbers. They will be found 
to be in the intervals 65-, 70-, 68-, 72-, 68-, 70-, 65-, 69-, 63-, 68- inches respectively. 

The mean of these values considered as located at the centres of intervals is 68*24, as 
against a value in the population of 67*46. 

Example 8.6 

To draw a sami>le of 12 from the population in the following bivariate table, showing 
the relation between inoculation and attack in cholera. 


Inoculated . 


Not inoculated 


Not Attacked. 

Attacked. 

Total. 

276 

(0001-3312) 

3 

(3313-3348) 

279 

473 

66 

539 

(3349-9024) 

(9025-9816) 


749 

69 

!“ 

1 818 


Totals . 
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There are now 818 members. We could, of course, take three-figure numbers from 
the tables, obtaining, e.g. from Table 8.5 

231, 575, 485, etc. 

But this is rather troublesome as the numbers are not grouped in threes. It is more con¬ 
venient to take four-figure numbers as before and to associate each member of the population 
with 12 numbers in the tables, e.g. the first would correspond to 0000-0011, the second 
to 0012-0024, and so on. We then get the numbers shown in brackets in the above 
table. Numbers above 9816 we ignore as before. 

The two numbers omitted in the previous example can now be used, and we find the 


following results :— 



1 

1 Not Attacked, j 

1 i 

Attacked. 

1 

Total. 


Inoculated . 

• 1 3 ' 

0 i 

3 

i 

Not inoculated 

i 

1 

1 

9 

» i 

1 

Totals . 

• 1 

1 

1 

12 1 


Here, for example, the member corresponding to the number 2315 falls in the not-attacked : 
inoculated class, and so on. 

It has so happened in this example that no member in the very small class inoculated : 
attacked class has been selected. Suppose we had had a series containing 

3314, 3323, 3333, 3341. 

All these fall into the group and there are four of them, as against only three members 
in the population. Had we been confronted with this position we should have had to 
decide whether the sampling was to be with or without replacement. If it was without 
replacement, we should have to suppose that the first three numbers in the group 3313-3348 
exhausted that part of the population and ignore all numbers of the group occurring sub¬ 
sequently. 

Example 8,7 

To construct a series of random permutations of the numbers 1 to 5. 

Here we are not concerned with the digits 0, 6, 7, 8 and 9 and so ignore them in the 
table of random numbers. We read through the table and note the digits as they occur, 
e.g. in Table 8.5 we have 2315, 7548, etc. The 7 is to be ignored and also the second 5, 
for one 5 has already occurred. We then reach the permutation 23154. Then we start 
again, the next series being 8, 5901, 8372, 5993, 7624, etc., giving the permutation 13254 ; 
and so on. 


Example 8.8 

To take a random sample of 10 from the normal population dF 


1 ... 


\/27t 


e 2 dx. 


This is a particularly interesting case, for we have to select a sample from an infinite 
population. Such a process, as has been seen, can only be considered as a limiting one. 
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Cdnsid^r the frequencies of the normal curve in ranges 0*1 on each side of the mean. 
These may bo obtained very simply from tables of the normal integral by differencing 
and in fact are given in many tables of that integral, e.g. that of Appendix Table 2. Suppose 
the frequencies rounded up to four places of decimals, e.g. those near the mean would be 

0(K 00398 

01- 00394 

02- 0-0387 

0-3- 0 0376, etc. 


and the total frequencies are given by the normal integral itself, e.g. 


Upper Limit of 

Frequency up to ; 

Upper Ljmit of 

Frequency up to 

Interval. 

that Limit. 

Interval. 

that Limit. 

0-0 

0-6000 

- 0-1 

0-4002 

0-1 

0-5398 

- 0-2 

0-4207 

0-2 

0-6793 

- 0-3 

0 3821 

0-3 

0-(U79, etc. 

— 0-4 

0-3086, etc. 


Wo may now attach a four-figure random number to this population, which is finite and 
discontinuous : e.g. the number 5401 corresponds to a variate-value -f 01- and the number 
3500 to - 0-4~. 

Had we taken the table to yi places of decimals we should have required n-~ figure 
numbers. Furthermore, we can make the approximation more exact by taking a finer 
variate interval. Such matters as this are to be decided in the light of the degree of approxi¬ 
mation required. 

8.14. Random Sampling Numbers must obey certain conditions before they can be 
used. Any set of numbers whatever is random in the sense that it might arise, with however 
great improbability, from random sampling ; but such a set might not be suitable as a 
table of Random Sampling Numbers. From the examples already given it is clear that 
we desire such a table to have very great flexibility. It should give random results in as 
many cases as possible, whether used in part or in whole. 

Now it is impossible to construct a table of Random Sampling Numbers which will 
satisfy this requirement entirely. Suppose, to take an extreme case, we constructed a 
table of 10'^'* digits. The chance of any digit being a zero is thus the chance that 

any given block of a million digits are all zeros is 10'"^®'. Such a set should therefore arise 
fairly often in the set of blocks of a million. If it did not, the whole set would 

not be satisfactory for certain sampling experiments. Clearly, however, the set of a million 
zeros is not suitable for drawing samples in an experiment requiring less than a million 
digits. 

Thus, it is to be expected that in a table of Random Sampling Numbers there will 
occur patches which are not suitable for use by themselves. The unusual must be given 
a chance of occurring in its due proportion, however small. Kendall and Babington Smith 
attempted to deal with this problem by indicating the portions of their table (5 thousands 
out of 100) which it would be better to avoid in sampling experiments requiring fewer 
than 1000 digits. 

8.15. If a table of random numbers is used to draw members from a population 
of ten, we expect the members to appear in approximately equal proportions. In other 
words we expect such a table to contain the ten digits 0-9 in approximately equal pro- 
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portions* Similarly we expect the hundred pairs 00^99 to appear in approximately equal 
proportions, and so on. Various tests of this kind, based on a comparison between actual 
frequencies and those required to satisfy the laws of probability, can be devised. No 
table can satisfy them all, but if it satisfies tests which (a) ensure the randomness of the 
numbers for the commoner types of sampling inquiry for which it is likely to be used and 
(6) are capable of revealing any particular sort of bias to which the numbers are susceptible 
in virtue of their mode of formation, it is likely to be of general application. 

For a more detailed discussion of these matters and the results of tests on the Tippett 
tables, the Kendall-Babington Smith tables and the Fisher-Yates tables, reference may be 
made to the works listed at the end of the chapter. 

Sampling from a Continuous Population 

8.16, Random Sampling Numbers offer the best method known at the present time 
of drawing random samples from an enumerable universe, and as was seen in Example 8.6, 
may also be used to draw samples from a continuous population specified mathematical^. 
But cases sometimes occur in which they cannot be employed. For instance, if we wish 
to take a sample of milk or flour, we cannot in practice number each particle and extract 
it from the population for examination. In such cases we are usually compelled to fall 
back on more intuitively grounded procedure. To take a random sample from a milk 
churn, for example, we might stir the contents thoroughly and scoop up a sample hap¬ 
hazardly. Sometimes, when the pojmlatiun is of manageable size, we can proceed system¬ 
atically by dividing it into a number of parcels and selecting parcels by the ordinary 
technique of random numbers. Most sciences have their own peculiar sampling problems 
and no attem^Dt can be made here to discuss them all. At this point we leave the technique 
of random samj)ling and assume hereafter, unless the contrary is stated, that the material 
we are discussing has been obtained by a random process. 


Sampling from Aftrllmics 

8.17. As an introduction to the general sampling jiroblems we shall eoiisider the 
sampling of attributes, which raises all the difticuliics of principle but is not obscured by 
too much mathematics. 

Suppose we have a random sample from a i>opulation whose members all exhibit either 
an attribute A or its negative not-A. Our sample is n in number, and a proportion p, or 
a number p/^, exhibit the attribute ; ami consequently a proportion q, or number qyi 
{p (/ = 1) do not. We will assume that the population is large, or that sampling is with 
replacement, so that the probability of obtaining an A at any drawing is not affected by 
other drawings and is therefore a constant, say w. 

The problems we have to consider are of tliree types :— 

(a) Suppose we have some reason for supposing that the proportion of A’s in the 
population is given by a known w. Does the observed proportion p bear out this hypothesis 
or is it so divergent from m as to lead us to doubt the hypothesis ? In an experiment with 
plants exhibiting two strains of a quality such as height in pea plants, wo may wish to 
test whether the breeding follows the simple Mendelian law of dominant and recessive. 
If we begin with two pure strains tall and short, cross-breed a first generation and then 
produce a second generation by interbreeding, the proportional frequencies of short ” 
and ‘‘ tallin this generation will be | and i if short is dominant and J and | iftall ” 
is dominant, provided that the simple Mendelian law holds. Suppose we carry out such 
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an experiment and find that for 400 plants the frequencies are 70 and 330. Can the diver¬ 
gence from the theoretical values 100 and 300 have arisen by chance, oris it large enough 
to throw doubt on the hypothesis that the simple Mendelian law is operating ? 

(6) In the foregoing type of problem we have some reason for testing a value of ra 
given a priori ; but we may know nothing of w, and in such a case our principal problem 
is to estimate it from the sample. 

{c) Then, having estimated it, we wish to know the degree of reliability of the estimate. 
How far is the estimate likely to deviate from the real value of ra 

8,18. Consider first of all the first type of problem, in which w is given a priori. If 
we choose samples of n fi'om the population the^^ will, on our supposition that the prob¬ 
ability of obtaining an A remains constant, be arrayed by the binomial 7i 
is to say, the probability of obtaining pn A'b and qn not-A’s in a sample of n is the term in 

^pn ^qn j Thus the probability of obtaining pti or fewer A's 

is the sum of the first pn 4- 1 terms in this binomial. 

If this probability is small we have the choice of three possibilities •— 

(a) An improbable event has occurred. 

(b) The hypothesis is not true, i.e. the proportion of A's in the population is not m. 

{(') The sampling process is not random. 

We can usually exclude (r) by taking care with the sampling process, and merely have 
to balance (a) and (b). It is in general accordance with the notions discussed in the previous 
chapter that we dismiss a hypothesis which gives rise to an improbable event in favour 
of one which makes it more probable. Thus if the improbability is great we reject the 
hypothesis, i.e. we are led to doubt (with greater or less force, according to the degree of 
improbability) the supposition that the proportion of in the jiopulation really is w. 
Per contra, if the event is probable it casts no doubt on the hypothesis. 

Example 8.9 

In certain coin-tossing experiments a coin was tossed 20 tim(*s and came down heads 
15 times. Does this conflict with the hjrpothcsis that the coin was unbiased ? 

The hypothesis we have to test here is that w The probability that in 20 tosses 

we should get 5 tails or fewer is the sum of the first 6 terms in -f- and will be found 
from Table 5.2 to be 0 0207. Thus the jirobability of such an event is small—the odds 
are 50 to 1 against the event—and we suspect the hypothesis accordingly. If, on the 
other hand, we had supposed the value of m to be 0*7 we should have found the first 
6 terms of (0*3 + 0*7)2« to be 0*4163, so that the event is no longer improbable, and we 
should not have rejected the hypothesis. 


8.19. In the example just given we purposely took a fairly low value of n in order 
that the terms of the binomiar could be calculated directly. In practice n is often fairly 
large—100 or more—and the evaluation and summation of individual terms would be 
most tedious. We can, if complete accuracy is desired, use the method of summation 
given in 5.7, and evaluate from the incomplete J5-function. But for all ordinary purposes 
it is quite enough to use the normal approximation to the binomial. We saw in Example 
4.6 that as n the binomial (x -f tends to the normal distribution with mean nw 

and variance 7^%. Probabilities can therefore be evaluated from the normal integral. 



STANDABD ERROE 


199 


In fact, for many purposes, it is not oven necessary to carry out the actual evaluations. 
From the tables of the integral (Appendix Table 2) we note that the probability of a 
deviation as great or greater imabsolute value than the standard deviation is 0*3173 ; than 
twice the s.d. is 0-0455 ; than thrice the s.d. is 0-0027 ; than four times the s.d. is 0*00006. 
Thus if we find np differs from nw hy more than twice Vnmx we begin to doubt the hypo¬ 
thesis, and if the difference is more than thrice Vnmx we may confidently reject it. 

Similarly, if the proportion p differs from m by more than twice . / ~ we begin to 

V n 

doubt the hypothesis, and so on. It makes no difference whether we compare the actual 
frequencies or the proportions. 

Example 8,10 

In some dice-throwing experiments Weldon threw dice 49,152 times, and of these 
25,145 yielded a 4, .5, or 6. Is this consonant with the hypothesis that the dice were 
unbiased ? 

If the dice are unbiased the probability of a 4, 5 or 6 is 1. Thus nw is 24,576 and the 
observed np is 569 in excess of this value. 

= ^'(1 X I X 49,152) = 110-9. 

The observed deviation is more than 5 times this quantity and we accordingly suspect 
very strongly that the dice were biased. 


Standard Error 

8.20. The quantity Vk^^^x) ^ particular case, appropriate to the binomial, of an 

important si atistical concept known as the standard error. It is the standard deviation of 
the sampling distribution of the parameter m. It is particularly important in the class of 
cases, which is relatively large, wherein that sampling distribution can be taken to be 
normal either exactly or to an adequate degree of approximation. 


8.21. Let us now turn to the case in which no value of w is given a priori. If the 
sample giv(\s a proportion of A \s equal to p, what shall we take as our estimate of m ? 
The most obvious <*ourse is to take p itself; and this is the course dictated by the more 
sophisticated ideas described in Chapter 7. 

Considei* first of all the method of maximum likelihood. The probability of obtaining 
np and nq a’s is 


.<“■» 

This is proportional to tho likelihood, and neglecting constants we have to maximise 

L -- — to)«« 

BE d 

for variations of to. We have, since L is non-negative, that —- and (log L)\ 

OW OCi) 

vanish together and it is therefore sufficient to maximise log L. We have 

0 


\ L dm) 




nq 

1 — to 


giving 


m = p. 


(8.2) 
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The method of Bayes will give the same result if we sut^pose the possible values of t& 


eqmlly distributed between 0 and 1 for dm —> 0. For then 

Ptw\f)~ L“?/ . . . 


. (8.3) 

nwr'n 


- ■ ■ ■ 

. (8.4) 


which, as before, is maximised when w p. 

There is another way of looking at this problem of estimation. Suppose we took a 
large number of samples from the population of m and x not-J’s. Our estimate of 
m would be p in each case, p varying from sample to sample ; and the mean value of all 
such estimates would be 


E{p) ^ ^ 

= ro{m ^ x)”~^ 
-= ro, 


(8.5) 


so that the mean value of our estimate over all possible samples is w. Such an estimate 
is called unbiased —if wo follow the rule of estimation the average of our estimates in a 
large number of cases will be exactly the correct value w. It may thus be argued tliat the 
unbiased estimate should be taken as a reliable estimate of m. 


8.22. In this case, therefore, all the approaches lead to the same conclusion (a 
happy state of affairs which, as we shall see in the sequel, do('H not always exist). CConsider 
now the next stage of the problem : what is the reliability of the estimate ? In other 
words, how far is tin? estimates likely to difl’or from the true value ? 

We know that if the sample value p differs from m by of the 

difference becomes smaller as t increases. Thus, with an assigned degree of probability 
we can say that it is improbable that p will differ from to by more than an assigned amount. 
But to specify this amount exactly we require to know m \ and this is precisely the quantity 
we arc trying to find. 

The problem can only be solved as an approximation. If n is large the standard 
error of m is of the order so that we may put 
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neglecting terms of order n*"®, 

- + 

Thus for large n the standard error of w is aj 

reach the fundamental result that in large samples of attributes the standard error may be 
calculated by using the estimates of the parameters under estimate instead of the (un¬ 
known) values of those parameters themselves. 

Example 8,11 

In a sample of 600, 240 are found to possess the attribute A, Thusp = 0-40, np ™ 240, 
\/(npq) = 12. We can thus regard it as somewhat improbable that 7fm differs from 240 
by more than twice this amount, 24, and highly improbable that it differs by more than 36. 
We thus can say with some confidence that nw lies in the range 240 i 24 and with gimt 
confidence that it lies in the range 240 ± 36. 

8.23. We now turn to a general consideration of the problems of sampling which 
have been excm])lified above. In the first place, let us note the role of the sampling dis¬ 
tribution in this branch of the subject. We construct from the observations some statistic t. 
The sampling distribution of this statistic will in general (but not always) depend on some 
parameters of the parent population. The probability of the observed t then permits the 
making of statements, by inverse probability, likelihood or otherwise, about these parameters, 
and thus we are enabled to draw inferences about the parent population. The sampling 
distribution is thus fundamental to the whole subject and several subsequent chapters 
will be devoted entirely to the methods of finding distributions when the parent is specified. 

If we wish to test some hypothesis about the parent which is expressible by the deter¬ 
mination of certain parameters a priori, the problc'm is fairly simple. Given the values 
of the parameters, we can determine from the sampling distribution the probability of the 
observed value of the statistic, and use this to assess the acceptability of the hypothesis. 
Complications can arise even liere, however, for in general, several statistics can be compiled 
from the same sample, and they need not necessarily all lead to the same conclusion about 
the hypothesis ; for example, a sample might have a mean which throws doubt on the 
hypothesis and a variance which does not. We shall discuss this difficulty more fully in 
the second volume. 

8.24. When the parameters of the population arc not given a priori, we have the 
double problem of estimating the parameters from the sample and assignmg probable 
limits to the estimates so obtained. We have already touched on some of the principles 
of estimation and shall develop the topic more systematically in duo course. When we 
have obtained an estimate —itself a statistic—we seek its sampling distribution and there¬ 
from can assign probable limits to the population value. A special class of cases arises 
when we can find a statistic whose sampling distribution depends on only one parameter 
of the population (as in the case of attributes). 

8.25. These latter types of problem permit of certain important approximations, 
namely in the case when the samj)le is large. We saw in Cliapter 7 that under very general 
conditions the sum of n independent variables, distributed in whatever form, tends to 
normality as n tends t6 infinity. Now many of the ordinary statistics in current use can 


1 Hq - py\ 

2 pqn^ J * 
>proximately equal to 


7 ^ 


n 


. ( 8 . 6 ) 
and wo thus 
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be expressed as the sum of variates, e.g. all the moments ; and many others may also 
be shown to tend to normality for large samples. Thus we may approximate— 

(a) By taking a statistic, calculated from the sample as if it were a population, to be 
the estimate of the corresponding statistic in that population, e.g. the variance of the 
sample may be taken as an estimate of the variance of the population. 

(b) By calculating the mean and variance of the sampling distribution by using, 
instead of the unknown parameter values, the statistic values calculated according to {a). 

(c) By assuming that the distribution is normal and hence determining probabilities 
from the normal integral with the aid of the sampling moan and sampling variance (the 
latter being the square of the standard error). 

8.26. Just how large ti must be for such approximations to be valid is not always 
easy to say. For some distributions, particularly that of the mean, quite a satisfactory 
approximation is given by low values of n, say 7i > 30. For others n has to be much higher 
before the approximation begins to give satisfactory results, e.g. for the product-moment 
correlation coefficient (below, 14.5) even values as high as 500 are not good enough. 

8.27. In the following three chapters we discuss the approximate and accurate 
methods for determining sampling distributions. Chapter 9 deals with large samples 
and is thus devoted mainly to methods for determining standard errors. Chapter 10 deals 
with methods for determining sampling distributions exactly. Chapter 11 discusses 
methods of approximating to sampling distributions by finding their lower moments. 
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EXERCISES 

8.1. Of 10,000 babies born in a particular country 6100 are male. Taking this to be 
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a random sample of the births in that country, show that it throws considerable doubt 
on the hypothesis that the sexes are bom in equal proportions. 

Consider how far this conclusion would be modified if the sample consisted of 1000 
births, 510 of which were male. 


8.2. If the number of members of a population bearing an attribute A is relatively 
small, show that the standard error of the number of ^’s in the sample is the square root 
of that number. Show also that the number of J[’s in the sample is an unbiased and 
a maximum likelihood estimate of the parameter of the Poisson distribution expressing 
the distribution of the number of A’s in large samples from the population. 


8.3. By considering the hyporgeometric distribution, show that if samples of it are 
drawn from a finite population of N without replacement, and a proportion w of that 
population bear an attribute A, then the standard error of the proi)ortion p in the sample is 



Show also that p is an unbiased estimate of to. 


8.4. (Tchebychelf’s inequality). Show that for any distribution 




and hence that for any member drawn at random 

P(| a; 1 > 

Show further that the variance of the sampling distribution of proportions bearing 
an attribute A in samples of from a population of attributes is not greater than Hence 
the probability that an observed proj^ortion p differs from the true proportion w by more 
than amount h is not greater than 

(This gives xis an exact result, no assumptions about the normality of the limiting 
form of the binomial or the use of estimates in calculating standard errors being involved. 
The limits are, however, much too wide.) 


8.5. If a proportion m has to bo estimated from a simple random sample with 
proportion p, and if/is the prior probability of vo, then the posterior probability of w is, 
according to Bayes' theorem, proportional to 

Show that this is a maximum if 

1 df ^^p(i 
f dw Tr}{l — w) 

Hence, in general, as it increases, the solution tends to w -=^ p, whatever the prior prob¬ 
ability of m. In other words, the maximum likelihood estimate is an approximation to 
that given by Bayes’ theorem as n tends to infinity, even if Bayes' postulate is not assumed. 
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STANDARD ERRORS 

9.1. Towards the close of the last chapter we discussed the estimation of statistical 
parameters from large samples and the type of judgment of their reliability which depends 
on the use of the standard error. It was remarked that, for large samples, an estimate 
of a parameter may be obtained by calculating from the sample values the value of the 
parameter in the sub-population composed by the sample ; and it was established that 
for samples of n the standard error gives a valid measure of precision, provided that (a) the 
sampling distribution of the statistic under discussion approaciies normality and (6) that n is 
large in the sense there defined. It was also pointed out that a sufficiently accurate estimate 
of standard errors involving parent parameters could be obtained by using as the parameter 
values the corresponding statistics from the sample itself. 

Since the majority of statistics in current use do tend to normality the theory of large 
sampk's is, in the main, devoted to the determination of standard errors. In this cliapter 
we describe the principal methods available for the purpose, and incidentally derive formulae 
for the standard errors of the various statistics considered in previous chapters. To avoid 
the usual square roots associated with the standard error we shall write our results as 
sampling variances and covariances. Thus, for a statistic t we write the variance of its 
sampling distribution as var i. The covariance of the joint distribution of two statistics 
i and u, that is, the first product-moment of their joint sampling distribution, is written 
cov {t, u). We shall also consider the distributions in large samples of some statistics which 
do not tend to normality. 

9.2. By definition, the rth moment of a statistic /, that is the rth moment of its 
sampling distribution, is the mean value of r taken ovt^r all jjossible samples, and may be 
written E(r) (cf. 3.35). If the joint distribution of the variates Xi . , , from which 
t is calculated, is dF{x-^ . . . .r^), then the rth moment of i is the integral of fdF (considered 
as a function of the a;’s) over the domain of the x'&. Tn particular, if the sample is simple 
and random and the parent distribution is dF, we have 

E{f) =- 1 • • ■ 1 V dF{x^) . . . 

J — QO J “ 00 

Wo are particularly interested in this chapter in the first and second moments of 
that is, the mean and variance of its sampling distribution. It may be recalled that the 
mean value of a sum is the sum of the mean values and that, if the variables are independent, 
the mean value of a product is the product of the mean values (3.36). These two results 
will be repeatedly required. 

Standard Errors of Moments 

9.3. In the first place we consider the standard errors of the wide class of statistics 
depending on the moments, including the mean, variance, the Pearson measures of skewness 
and kurtosis and the moments and cumulants themselves. 

The sampling distributions of moments tend to normality under very general conditions 
in virtue of the Central Limit Theorem. In fact, if the parent distribution is represented 

204 
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1 f L\ IzI 

hj f(x) rfar, the distribution of the jth power of x, say y, is easily seen to be )y * 

and the jth moment is the sum of n independent variates, each of which is distributed in 
that form. 

It is not so obvious that functions of the moments such as bi and (the sample values 
of the parameters and ^ 2 ) will tend to normality, and special investigations may have 
to be made for particular statistics. Even at the present time it is often assumed without 
proof that certain statistics tend to normality, the feeling apparently being (so far as any 
feeling uprises into consciousness) that as most statistics do tend to normality the onus 
is on an objector to prove that any particular statistic does not. This is very dangerous 
to accurate inferential reasoning and the point is one to be borne in mind whenever a standard 
error is used. 

On a similar point, it should also be remembered that some statistics tend to normality 
more lapidly than others, and a given n may be large for some purposes but not for others. 
So far as it is possible to generalise with safety, we can usually (but not always) assume 
values of n greater than 500 to be large ; values greater than 100 are often great enough 
to be large for our purposes ; values below 100 are suspect in many instances ; and values 
below 30 are very rarely large. 

In the following we shall adopt the usual convention in regard to the distmetion of 
])arameters and statistics by writing Greek letters to represent the former and Roman 
letters to represent the latter. We have, then, for the rth moment-statistic m], corre¬ 
sponding to the rth moment parameter /i]. 


7N 


and for the mean-moment 


J 1 


(».l) 


(9.2) 


9.4. Consider now the mean value of Since the x's are independent we have 


n 

^ E{x^) 

The sampling variance of is, by definition, E{m\, — and thus 
var (to;) = E^S(x^) - yi/;| 


. (9.3) 


= - 2n^i^(xr) -h « v;**] 

It 








n 


-£?{2:(x/o + ^(VV)} - 


the second summation extending over the n(rt — 1) cases in which j (permutations 
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ofj and k thus being allowed). Since the x*b ar6 independent the mean value of the product 
is the product of the mean values, and thus 

var (m;) = :4{w./^2r + Mn - l)^r^} - 

Tv 

= ^(/“2r - /‘r^).(®-4) 

iV 

This is an exact result. 

In a similar way, if we have two moments, m\.y their sampling covariance is given by 
cov (m;, w',) -= E{(m'^ - 

" ^ "0} 
fU fv tv 

= fr - /<>r)..(9.5) 

which reduces to (9.4) if g = r, as it must, for the first product-moment of two identical 
variables is their variance. 

9.5. The formulae for moments about the mean are not so simple, for the mean itself 
is subject to sampling fluctuations. We have, in fact, 

- "h)’’).(9-6) 

Now 'putting r = 1 in (9.4) we find 

var (m,) = 

Tv 

- .<’>•’> 

and thus the standard error of the mean is Consequently, if the distribution is 

anywhere near normality, nearly all the values of x will lie within a range of the true value 
of order n~^. To order wt may then, taking an origin at the mean of the parent 
population, neglect powers of 7r}\ higher than the first, and we then obtain from (9.6) 

E{rY}j) = ~E{L(x^ - - 
71 

= - r^-ZxEx--A 

71 71 j 

S', 

Now the second term in the expectation on the right will involve the moments and 

will vanish since we have chosen our origin at the mean of the parent distribution = 0). 
We shall then have, to order 7i~’^ 


E{7Hf,) — 


(9.8) 



STANDARD ERRORS OF MOMENTS 207 

a result which is not, like (9.3), exact, but is an approximation to order n~^. To this 
order we have 


var (m,) = 


n 


- /V* 




j y‘ 

The expectations of other terms occurring in the squaring vanish, since tliey contain 
1 3 

The expectation of - is of order and is thus to be neglected. The 

71 71*“ Ti 

remaining terms give us 

var {mj) 

Similarly it a])p(*ars that 

(•OV(»rt„ W„) hl > r^q 


ill-ir - + rV* /^^-l - 2 r/i,_, //,.+ ,). 


(9.9) 


I'rl'q -I /'«-1 " /'« U “ 9/'r+l ^a-l) • (^^-l®) 


Exainple 9J 

JbVom (0.7) we have 


var {mi) = 


fU 

n * 


Now, for the height distribution of Table 1.7 we found (Examples 2.1 and 2.6) that 
rrq =- 67*46 \/^2 2-57. Suppose we regard this distribution as a simple random sample 

from the adult male inhabitants of the United Kingdom living at the time when the data 
were collected. What can we say about the mean of the population ? 

The standard error of the mean depends on This is an unknown quantity, but we 
may, in accordance with the general principles of large sample theory, use instead. 
We then find 


Standard error of m'l = 


7 


2*57 

-= 0*028 approximately. 

oOo«.) 


Thus we can say that the population mean probably lies in the range of twice this amount 
on either side of the sample mean, i.e. in the range 67*46 ± 0*056, and very probably in 
thrice the range, i.e. 67*46 rb 0*084. Our estimate of the mean would almost certainly be 
less than a tenth of an inch in error. 


Example 9.2 

Prom equation (9.9) with r == 4 we find 

var (W4) = ^(/^8 — fil — 8/^6/i8 4- lO^a/^a)* 
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la Chapter 11 we shall show how to obtain this result by other methods of a more exact 
character and confirm that it is, in fact, exact to order 

Example 9.3 

To show that in samples from a symmetrical population the first product-moment 
between the mean and any mean-moment of even order vanishes to order 
We have, by definition 

cov (w'l, m^) = ~^E^S(x){S{x^) - 

the other terms vanishing, since they involve the unit power of if wc take an origin at 
the mean of the parent population, 

= _i). 

Now if r is even, and being moments of odd order, will vanish for a sym¬ 

metrical population and hence 

cov {m\, n\) 0. 

Jn the language of the theory of correlation (Chapter 14) the mean and the even moment 
about the moan are uncorrelated to order 

Standard Errors of Functions of Moments 

9.6. From the expressions we have just derived for the sampling variances and 
covariances of moments, approximate expressions can be obtained for the sampling variances 
of functions of the moments. Suppose <i>{ni) is such a function. We have the functional 
relation in differences 

^ Ami 4~ . f 0(Am)^. . . . (9.11) 

dm^ dm^ 

Now any variations in m due to fluctuations of sampling are of order 7i~‘K To our approxi¬ 
mation, therefore, we may neglect the terms of order (Am)^ in (9.11), and the variation A(f» 
is then seen to be a linear function of the variations Afn and is equivalent to an equation 
in differentials ; that is to say, since the m’s are distributed normally in the limit, so will 
<f> bo. We have, from (9.11), 

Hence, measuring from the means of the m’s and <f>, we find, squaring and taking mean values, 

var (*) _ var («,)} + ir{l^ ^ oov (m„ „.)| . . (9.12) 

the first summation extending over all the m’s appearing and! the second oveI^ all 

m’s such that j ^ Ic. 

Similarly, for two functions we have 

cov i.) _ var (m,)} + |^cov (m„ „.)j 


\ 


V 

. (9.13) 
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Example 9.4 

To find the sampling variance of the fourth cumulant. We have 

K* = Pt — Sf4 

dK^ — d[Jl.^ — 

Hence, squaring and taking mean values, 

var (« 4 ) = var (//i) — 12 jMa cov (/<«, + 36/f| var (//,). 

Making the appropriate substitutions from (9.9) and (9.10) we have 


var {k,) — I {/xs 

fb 


H\ + — 8/y,//5 — 12/<2(/<, — — 4^1) + — i«4)} 


For a normal parent, yW 4 == 


— SyWsjWa *- 
3(7*, == 15(7*, /ig 

var (/C 4 ) = 


+ 48//4/^2 + 64//^//a 36//*^}. 

105(7® and we have 


n 


Example 9.5 

To find the sampling variance of the coefficient of variation 

100V^^2 


V ^ 


m, 


Taking logarithms and then differentials we have 

(iF _ dm\ 

V 2m a mi 

Whence, squaring and taking mean values, 
var V _ var ma 1 

~yj 


4m I 


cov {mzni't) + 

ntirrii m 


var m'j _ I ///4 •— /4 
m\^ ri\ 4m| 


/W3_ ^ /^2 






0- 


To our order of approximation we may write =~ and find 

var F _ --f'. I "fA 

//\ 4/i- //17 

For a noiinal parent this gives (//4 ~ 3 // 2 > fH — 0 ) ; 


var 


F == ^-Yl + = LYi + 

rtV^ /qV 2 reV lOV 


F* 

~ ~ approximately. 

9.7. On the above principles the standard errors of the more usual functions of 
moments, such as the measures of skewness and kurtosis, have been worked out and 
tabulated (see Tables for Statisticians and Biometricians and the references at the end of 
the chapter). 

In applications of results derived by the foregoing methods a few points are to be noted : 

{a) The sampling variances are to be used only when the statistic under consideration 
is calculated from the moments. For instance, if the standard deviation of a normal 


curve is estimated by taking 


V(f) 


times the mean deviation of the sample, instead of 


A.S. 
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the more usual root-mean-square, the formula var (a) — 


— l4) 

472/^2 


derivable from (9.9) is 


not applicable (see below, 9,11). 

(6) From (9.4) and (9.9) it will be seen that the sampling variance of a moment depends 
on the moment of twice the order, i.e. becomes very large for higher moments, even when 
n is large. This is the reason why such moments have very limited practical application. 

(c) Some measures calculated from the moments tend to normality very slowly. 

y/bi or (the sample values of Pi) cases in point, and more refined methods 

which we discuss in Chapter 11 are preferable to the use of the standard error. 

(d) The order of the approximation makes it necessary to exercise care in the neigh¬ 
bourhood of vanishing values of standard errors. For instance, if the coefficient of variation 
F = 0 in a sample, the formula of Example 9.5 would give var F = 0. But it does not, 
of course, follow that there is no variation at all in the population, though none exists in 

the sample and the presence of variation in the parent will be unlikely if the sample is at 

]/2 

all large. When F = 0 the quantities neglected in our approximation giving var F = ~ 


become of some relative importance, though they are still small. 

(e) It is interesting to compare the sampling fluctuations, as expressed in the sampling 
variance, with Sheppard’s corrections to the moments. Writing temporarily sf for the 
uncorrected variance in the sample, for the corrected variance, we have 

_ 1 _ 1 

12 sf ’ 

where h is the interval width. For many practical cases, if d is the number of intervals, 
dh is about equal to 6si, and thus 

=== 1 _ 1 
s 3 

= 1-approximately. 

Si 2d^ 

For a normal population we have 


and hence 


a 

da —- 


1 

1 


d^i2 


var a ~ -var Wg 

4/^2 


/^4 




4/^2^ 


iWa ^ ^ 

2n 2n 


Thus if n is, say, 1000, the standard error of a is about 0-0224 a = 2-24 per cent, of a, 
Sheppard’s correction in a case where d = 20 is only 0-375 per cent, of St, i.e. only about 
a sixth of the standard error. It is as well to make the corrections, even when n is smaller 
than 1000, in order to avoid systematic error : but the correction should not be mis¬ 
interpreted as implying a higher degree of reliability in the corrected value than actually 
exists. 

Similar considerations apply a fortiori to the higher moments. 
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Standard Error of Bivariate Moments 

9.8. Extensions of the above formulae to the bivariate case are made without difficulty, 
only slightly more complicated algebra being involved. The reader will be able to verify 
the following formulae for himself: 

var (m;^ J == 2 « ^ /4,^).(9.14) 

cov (m;^ ~ /4,r).(9-15) 

var J ^ /^\s + ^> 2.0 

+ . + 1 * (9.1^) 

COV J = Uf^r+u,s+v — t^r,sf^u,v + f^r-1, 8 

+ 5?;//o. 2, //r, s^l M-u, p-1 + 1 /^r-1, « /h..r-l, 

+ 1 flj. V 

«+l /^w, v—1 1, s /^M-l 1, w 1 M'u, v—l) * (9.17) 

Example 9.6 

The coefficient of correlation is defined by 


r — 


ni. 


dr 

r 


dniii 


V(m2omo 
- dtw 20 

" Woo " Wo 


1 var (Wii) , ^var (Wgo) cov (Wji, Wgo) , • -i . 

-- var ir) == ' —- + \ \ -- — --V—-- + similar terms, 

^2 /m2_ * 


We have 
Thus 

r'** ‘ 

from which, substituting appropriate values from (9.10) and (9.17) and writing for 
in the result, we liave 


var (r) = 

\j“ii j“lo 


/^02 /^20/^02 


/^I3 Y 


p being the same function of the /x’s as r is of the w’s. For the bivariate normal distribution 
the substitution of values of Example 3.15 gives 

var (r) = i (1 - p^)\ 

The use of the standard error to test the significance of the correlation coefficient is 
not, however, to be recommended. 


Standard Errors of Quantiles 

9,9. Among the various quantities measuring location and dispersion which we 
considered in Chapter 2 there was one group, namely the quantiles, which are not symmetric 
functions of the observations and whose sampling variances cannot accordingly be deter¬ 
mined by the above methods. We proceed to consider them now. 

Suppose the parent distribution is represented by F{x) = f(x) dx. The probability that, 
of a sample of n, (Z — 1) fall below a value x^, one falls in the range a^i ± | dxx and the 
remaining {n — /) fall above Xi is proportional to 

F{xxr^ f{xx) dxx{l - F(xOr~' = ~ FxT-^ dFx, 


. (9.18) 
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where Fi = F(Xi). This expression is accordingly the distribution function of the 

I 

member of the sample below which a prox)ortion — of the members fall, i.e. the ith quantile. 

Put I ^ nq 

so that n — I = n(l — q) 

= np, say. 

The distribution (9.18) has a modal value given by differentiating the frequency function with 
respect to Xu i*e. (taking logarithms first) by 




. (9.19) 


this equation being satisfied by the modal value x. Now for large the factor ~ will in 

general bo small compared with the other terms in (9.19), I and 7i — I being large. We may 
therefore neglect it, and (9.19) becomes, to order 


or F(z) = q. 

This is in accordance with our general assumptions. To order the quantile of the sample 
is the quantile of the parent. 

Now let us investigate the distribution (9.19) in the neighbourhood of the modal value. 

Put 

Fi = g 

(9.18) becomes (neglecting constants) 

(q + sy^ip - 

Taking logarithms and expanding we have, except for constants, 


nq log -f + np log ^1 - 

"<+1■• ■)+»<■ I “*? ■ ■ ■) 


tic 

== — -f terms of order f ® and higher degree in f. 

Now for large samples f will be small compared with g, and we neglect the terms of higher 
order. Thus the distribution of f is 


dFccexp(---^yi 

or, evaluating the necessary constant by integration, 

dF — - ^ exp . 

V2-,r J(^\ ^ ; 

showing that f is in the limit distributed normally with variance 

var (^) = ??. . 

n 


. (9.20) 


. (9.21) 



213 


I 

STANDARD ERRORS OF QUANTILES 

This is the variance of which is a proportion. To find the variance of Xi we note that 
dS = dFt *=» fidxi and hence that 

var (a:,) = ^. .(9.22) 

In practice this formula is often applied to grouped frequency-distributions, and in such 
applications it is to be remembered that /i, the ordinate of the parent, is to be taken as the 
frequency per unit interval at this being the best estimate of the ordinate. 


Example 9.7 

If Xi is the median, p = q 


^ and wo have var (median) 


_i - 


where/i is the median ordinate. For instance, if the parent population is normal, the median 
ordinate is (from Appendix Table 1) ^ 0-39804, a* being the variance of the parent. Hence 
the standard error of the median is 


Vn2x 0-39894 


=r 1-2633-^. 

y/n 


The standard error of the mean in samples of n from a normal population is 
is thus considerably smaller than the standard error of the median. 


which 

y/n 


9.10. To find the covariance of two quantiles we generalise equation (9.18). If we 
have a random sample of n individuals the probability that (Z 1) lie below Xi, one lies at 
zt {n — Z — m) lie between and one at ± \dx^, and the remaining (w — 1) 

above is 

(JF oc “ F,Y^~hlF^ dF^, . . . (9.23) 

where F^ == F{xi), F^ = ^(aja). 

We put I =- q^n 

m = p^n 

and find, for the equations giving the modal values corresponding to (9.19), 

== 0 

P. F~ - F, 


“JZi _ P2 

F^-F, l-F, 


giving, for the limiting modal values, 


F(£,) ^ 

F{jc^) ==• ^2j 


The conditions as to the relative smallness of 


/(^) 


put 


are satisfied in any ordinary case. 


(9.24) 

Now 


= <?i + 

F 2 = (Z 2 4" ^2* 
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The joint distribution of and then becomes 

dF OC (q, + - gr, + f- f,) d^. 

On proceeding as in the previous section, taking logarithms, expanding and neglecting terms 
in and higher, we find ultimately 

dF OC exp /- . . ( 9 . 26 ) 

I 2(q^ - /J 

Thus the joint distribution of fi and fa tends to the bivariate normal form, and on comparing 
(9.25) with the canonical form (Example 3.15) we see that 

1 __ 

(1 ^“p2)“vaF(f7) “ (TT- 

1 _ Tfpi 

(1 - p^) var (fa) (ga -- gi )/>2 

_ ^ _ __ P _ . 

(1 cov (fifa) (1 - /^^Jy'lvar (f,) var (fa)} (ga — q^y 

whence it is easy to find 

var (fi) = 

71 


var (fa) 


n 


COV (f,, h) = .(!)-20) 

n 

The asymmetry of the result for the covariance is due to the fact that pa relates necessarily 
to the upper quantile. For the corresponding exj)ression in and x^ we have 

cov (.r„ X,) =.(9.27) 

»SJi 

With equations (9.26) and (9.27) we can find expressions for the variances of tlie quantile 
range and similar statistics. 


Example 9,8 

The variance of tlie difference d of two quantiles at Xi and x^ is given by 


dd “ dxi — dxz, 

var (^) = var (x^) -f var {x^ — 2 cov {Xi, x^) 

= i/1- 

<7f n fxU j* 

When the quantiles are the two qua-rtiles, p.^ ~ gi = J, Pi = ga fhe variance 

of the <9em^-interquartile range we have 


var (s.i.q.) 


64nV/!^/| 




where/„/j, are the frequencies pt>r unit interval at the two quartilos,/^ relating to the upper 
quartile. As /„ /j have to be estimated from the sample, we may also write 


... oV3 , 3 2 

var (s.i.q.) = —-( - 


;)■ 


where gi, are the actual sample frequencies at the quartiles and a® is the sample variance. 
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For instance, if the parent distribution is normal, gr, = gr, and we find 


var (s.i.q.) 


lQng\' 


From the tables the deviate corresponding to the quartile is 0-6746 and the ordinate at this 
point, gi — 0-3178, so that the standard error of the semi-intcrquartile range is 


a 

y/nA X 0-3178 


= 0-7867- " 

■\/n 


9.11. In amplification of the point mentioned in 9.7 (a) it is worth while stressing 
again the fact that a standard error is related to the way in which a parameter is estimated. 
For instance, the standard deviation of a normal curve can be estimated from a sample in 


several waj^s : 


from the second moment; by taking 



times the mean deviation ; 


by 


taking 


1 


times the semi-interquartile range ; and so on. Each method will have 

a 


0.6745 

its appropriate standard error, that for the first, for example, being 
1-6495(7 


, and that for 


At a later stage considerations such as this will lead us to the inquiry, 


the third , 

what is the estimate, if any, with the minimum sampling variance ? For present purposes 
it is enough to note the importance of not using a quoted formula without reference to the 
method of estimation of the parameter concerned. 


9,12. The methods we have developed provide the standard errors for large samples 
of most of tlie measures of location and dispersion and the measures introduced in Chapters 2 
and *1. There remain a few on which we have not yet touched, viz. the mean deviation, 
Gini's coefficient of mean difference, and the range. We consider them briefly in turn. 


Standard Error of the Mean Deviation 

9.13. The mean deviation, as was pointed out in Chapter 2, is relatively speaking 
a complicated function, and the mathematical difficulties attendant on absolute values are 
well iltustrated in discussions of its sampling variance. In fact, no general discussion of the 
sampling distribution appears to have been undertaken. The following exact value of the 
sampling variance in samples from a normal population was discovered by Helmert in 1876 
and rediscovered by Fisher in 1920. 

var (m.d.) = | + V{n{n — 2)} — n + sin-i— 

rw for large n. ...... (9.28) 

n \ 71/ 

The proof follows the general methods described in the next chapter. It is quoted here 
for the sake of completeness. 
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Skmdard Error of the Mean Difference 

9.14. Nair (1936) has given a general expression for the standard error of Gini^s mean 
diflFerence without repetition. In the manner of 2.24 it is easy to see that the co¬ 
efficient may be written 

/J, = 2 ,2C7-(»+1)F} . . . .(9.29) 

7i{n — ij 
n 

where U == 


and we write n in preference to N for the number of observations, since we are dealing 
with a sample. 

In our usual notation, the probability that the ;th observation in order of magnitude 
in a series of n observations has value in the range x ± \dx is 

dF = ,. -- F,r-^dF,. 

(3 - 1)K« --3)' 

Hence the mean value of t/ is given by 

= »r xdFlz^.- _ Fr-i 

J_«. \ 3 - !!(» ~3y- 

+ {n- 1)F .,Fi-'\l - F)"-4 

j~2!n-j! J 

= n[ a:(ZF{l + (m-* 1)F} ...... (9.30) 

J —oo 

Similarly 

E{V) — n^xdF. ........ (9.31) 

Thus 

^ 

= 2jx(2F -l)dF. 

In the same way (but we omit the details) Nair finds 


. (9.32) 
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where 


7, = r a;*((n - 1) - 4(w - 2)F + 4(» - 2)F^}dF 

J —00 

/, == f a:,dF,[ ridFi{{n — 3) — 2{n — S)Fi — 2(a — 1)F, 4(n — 3)FxF,} 

J —OO J —QO 


and finally 

YaT{A,)^E(Al) - {E{A^)y, 

For three particular cases these integrals are worked out, giving * 
Normal Parent: 


(IF = 
E{A^) ^ 
var (A) 


aV 271 
2a 
\/n 


dx. 


00 < a: < 00 


4a^ fn -i 1 ^ 2{n - 2(2?? 3) 


Expo7ie7itiaI Parent: 


Rectangular Parent: 


n(n — 1)[ 3 71 

‘^-(0-8068)“. 

n 


1 '•** 

clF = - e da\ 0 x < no 

a 

E{A^) = o . . . . 

var(J0 =• 

Zn{n — 1) 


(T . 

3w 


dF jdx () < J. L 
h 

E{A,) = \k . 

t A \ -|- 3 

var (zl,) = 


n 


9 5n(n — 1) 
45»' 


(9.33) 


(9.34) 

(9.36) 


(9.36) 

(9.37) 

(9.38) 


(9.39) 

(9.40) 

(9.41) 


9.15. We now turn to consider some statistics which are peculiar m more ways than 
one—the extreme values of a sample (or, more generally, the rwth value from the top or the 
bottom of a sample) and the ratige. One of the unusual features of the distribution of mth 
values is that as n increases it diverges more and more from normality ; and it seems doubtful 
whether the distribution of range tends to any limit at all—certainly it does not tend to 
normality in all cases. 

A further difference between the quantities we are now considering and the others we have 
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already discussed is that mth values and range in the sample are not used to estimate .mth 
values and range in the population. In fact most of the results we shall obtain relate to 
parents which have an infinite range. What, then, is the use of these statistics? The 
answer is that they may provide an estimate of parent parameters which do exist. For 
instance, an estimate of the variance of a normal population is given by dividing the sample 
range why s, constant depending on the number in the sample. This estimate, though 
not so accurate as some (in the sense that its sampling variance is not so small), is extremely 
easy to calculate and is often useful. We wish, therefore, to know its sampling variance, 
that is to say the sampling variance of the range. 


Distribution of mth Values 

9.16. We consider first of all the distribution of mth values from the top, that for 
mth values from the bottom being similar. In particular, m may be unity, in which case we 
get the greatest member of a sample. 

Quantiles are special cases of this class of statistic, the ratio m/n remaining finite as n 
tends to infinity. In the case we now discuss m remains finite, so that the ratio m/n tends to 
zero. 

The distribution of mth values from the top is, as in equation (9.18). 

dF cc — jPj)m-i .... (9.42) 

When the form of Fi is known, this equation is sometimes capable of exact solution, as in the 
following example. 


Example 9.9 

Consider the rectangular distribution dF = r/r, 0 < r <1. Hero F{x) = x and the 
distribution of the mth value from the top is 

dF oc dx, 

the Pearson Type I curve. We have, for the first moment, 

m + 1^^ m 
“ r). + 1 ” ~ n + 1 

and for the variance 


__ (n — m + l)(2n — m) 

~ {n + 1)(« + 2) ’ 

but this sampling variance cannot be used in the ordinary way if m is finite, for the curve 
does not tend to normality. However, we may easily obtain exact values fc J the probabili¬ 
ties associated with the mth values, from the integrals of the Type I curve. In fact, the 
probability that a given value will not be attained or exceeded is, in the usual notation, 
4(n — m + 1, m). 


9.17. From this point our discussion of the limiting form of (9.42) as n tends to infinity 
is confined to the case wherein the parent population is a continuous frequency-distribution 
of unlimited range of the exponential type, i.e. such that it tends to zero with large x as fast 


as or faster than dF = dx, and that 


exceeds some fixed number as x 


j^log/W 

tends to infinity. The normal curve obeys this criterion, which implies, among other things, 
that all moments exist. 
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For the mode of (9.42) we have, as in (9.19), 

For large n and finite m the mode Xi will be a large value, and both/i and 1 — Fi tend to zero. 
Accordingly we may put 


ft ± 
dx 


(1 - F,) 


_/l_ 

1 -F, 


in accordance with the rule known as L’Hopital’s. Hence 

A 


f 

(n - TO)jf - m~ _ 
F^{x) = 1 - 


-F, 

m 

n 


0 


Now expand in the neighbourhood of x by Taylor’s theorem. We get 

m (x — x)^n^ 


F{x) = F{£) + ~-/(x) -f- ^l'/'(x) -h . . . 


= 1 __ 

n n m 


2 ! 


{f(x)y +.. . 


(the last term in virtue of /i ^ — —-p in the neighbourhood of the mode) 


m 

~ exp | — [►approximately 


1 


m 


say. 


. (9.43) 
. (9.44) 


The distribution of the mth value from the top may bo written, from (9.42), 

dF„, cx ~ l)'"-' d(F»). 

TYh 

To our approximation, from (9.44), since — is small, 


(-;-r=(r::v«~-‘) 

(r)’" 

d ( F ") - »(^1 - ^ 


n J n 


and 

Thus dFjn cc exp (~ my^ — dy^ 

and, on evaluating the constants by integration, we get 


- (w - 1)! 


exp (— my„ — me >"^)dy^. 


. (9.45) 
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The new variable is defined in terms of or — c? by 




nm 


m 


In a similar way, for the wth value from the bottom we find 


dF = 


m/* 


(m — 1)! 

^ being written for the variable defined by 


exp — me-*') dy, 


F = -e-*'. 
n 


In particular, for the extremes (m = 1) we have 

dF = exp ^ — c'“*') dy (top value) 
dF = exp {y —- e*') dy (bottom value) 


. (0A6) 


. (9.47) 
. (9.48) 


9.18. These unusual limiting forms, which are due to Gumbel (1934), the extreme cases 
being due to Fisher and Tippett (1928), are very far from normal for moderate or low values 
of m. For the moments of (9.45) we have (omitting the suffix of y for convenience) 


Put 






(^-l)U-oo 

-. We get 
m 


fi'i = 


I (log t — log e~^ dt 

(m — l)!Jo 

- log m + -y- {log r (m) } 

am 


= - log m + y - .(9-^9) 

where y is Euler’s constant. For the rth moment about the mean we have 

Mr = < - log m + e-' dt 

= + 3)1 . • • (9-50) 

r(m) Id^ 


These formulae have been worked out further by Gumbel, from whose numerical results the 
following are chosen :— 


m 

Mean 

Pi 

^2-3 

1 

0-577 

1-139 

2-400 

3 

0-176 

0-621 

0-763 

6 

0-103 

0-468 

0-437 

10 

0-051 

0-324 

0-212 


These figures, which relate to the distribution from the top, show clearly that the limiting 
distribution is far from normal. The distribution from the bottom is similar, odd moments 
including the mean having the same magnitude but opposite sign, even moments being the 
same. 
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Moreover, the limiting forms (9.45) and (9.46) are reached extremely slowly. Fisher and 
Tippett (1928) have shown in the case m = 1 that they do not provide a very satisfactory 
approximation for values of n less than 10^^. For practical purposes, therefore, there is still 
no adequate general approximate form for the distribution of mth values. 


9 The case m = 1, corresponding to the extremes of the sample, has, however, 
been studied in more detail. In this case equation (9.42) becomes 

dF = — dx^. 

By using the published tables of the normal integral Fi, Tippett (1925) has evaluated F for 
values of n up to 1000, and given diagrams yielding the variances, and which are 

reproduced in Tables for Statisticians and Biometricians, Part II. The following values are 
quoted from his results :— 


n 

Moan 

Standard Deviation 

h 

Pz 

2 

0-664 

0-826 

0-019 

3-062 

5 

1-163 

0-609 

0-092 

3-202 

10 

1 639 

0-687 

0-168 

3-331 

100 

2-508 

0-429 

0-429 

3-765 

600 

3-037 

0-370 

0-670 

4-003 

1000 

3 241 

0-3.51 

0-618 

4-088 


The values of Pi and /?2 illustrate the point that as ?? increases, the distribution of the extreme 
value diverges more and more from the normal form. 

The limiting values as n — oo can be derived by the use of characteristic functions. 
In fact, we have for the distribution of the top value, 

= f exp (—a: — e""®) d.r, 

J —00 

which, on substituting == gives 

<^(0 = f (-“e-^di 


Hence 


- r(i - n). 

«,(,7) + + ... log m - log r{i - it) 

= y(if) + 


Thus 


whence 


== -= r 

== /X, = Si = -1 = l-644«34 
= 2Si =- 2-404114 

7r4 

fU - 3^1 -- 6Si = -- = 6-403939 

(ffi = 1-299 
Pi = 6-4. 

• Cf. Edwards, Integral Galcndua, vol. 2, article 916. 


iSr here is 
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These are evidently far from equal to the values for n = 1000 given above. Clearly the 
limiting form is an inadequate approximation for values of t? much higher than 1000. 

9.20. The problem of bridging the gap between Tippett’s values and the limiting 
form has been considered by Fisher and Tippett (1928), and the argument which they 
employ is interesting. Concentrating for a moment on the upper value, we note that the 
upper member of a sample of kn members is the upper member of a sample of k of upper 
members of samples of n. Both distributions will tend to the same limiting form, if it 
exists ; and consequently the limiting value must be such that the extreme member of a 
sample of n from it must itself have that distribution. That is to say, if F is the prob¬ 
ability of an observation being less than x, 

.(9.51) 

where and 6^^ are functions of 

It may be shown from this equation that F must be one of three forms-— 

(JF == exp { — X — e~^)dx ...... (9.52) 

dF {— x~^)dx ...... (9.53) 

dF == A(~- exp { — ( — xy^}dx .... (9.54) 

The first we have already reached. The second and third arise if the original distribution, 
instead of tending to infinity exponentially, tends less rapidly such that 

lim (1 — F)or^ exists and is not zero. 

The distribution (9.54) itself has (9.52) as a limiting form as A tends to infinity. It 
has therefore been proposed as a penultimate ” form, to bridge the gap between n = 1000 
and n = 10^ 2 , which is apparently the first point at which the ultimate form provides a 
reasonable approximation. For the penultimate form we have 

fi\ = f A{—x)^ dx 

J —QO 

i 

and on putting — x = M 

jiiy. = J (“1)'*^^ df 

The following values illustrate the relationship between the known form (n = 500, 1000) 
and the penultimate form : 


1 

i 1 

71 

Standard Deviation 

1 



Pi 


1 

_ 


Penultimate 

Actual 

Penultimate 

Actual 

Penultimate 

Actual 

1 

0*0768 ( 

1000 

0-3433 

0-3514 

1 0-548 

1 

0-618 

3-862 

4-088 

0-0845 1 

600 

0 3604 

0-3704 

0-498 

0-670 

i 3 761 

4-003 
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Distribution of Range 

9.21. The range is the difference of the highest and the lowest value of a sample, and 
the simultaneous distribution of top and bottom values is, from (9.23), 

dF oc (F, dF, dF^ 

- n(n l)(Fi ^ F.r^^ dF^ dF,, . . . (9.55) 

The distribution function of the range w is then given by integrating this distribution over 
values of Fi and F, such that x, — Xi < w, 8o far as I am aware, it is not known whether 
limiting forms of this distribution exist or what they are. It is, however, evident that 
for large n the range is also large, and it seems doubtful whether the difference of two 
variates which (for an unlimited curve) tend to + oo and — oo respectively has any general 
limiting form. In any case one would suspect that the limiting form is reached slowly. 

For particular cases equation (9.55) is soluble explicitly. The normal ^aso has been 
fairly completely studied by Tippett (1925) and E. S. Pearson (1925 and 1932). Tippett 
found the first four moments of the distribution of the range, tabulated the mean values 
for values of n up to 1000 and gave a diagram for determining standard errors. (These 
tables and diagram are reproduced in Tables for Statisticians and Biometricians, Part II.) 
Briefly, his approach is as follows ;— 

From (9.55) we have, for the mean range E{w), 

E(w) = «(«, - !)[” (-fi - - X,) (IF,. . . (9.66) 


On expanding {F^ — wo get terms under the second integral sign like 

1 


I' 


- ^ 2 ) dF, 


[‘ 


s + 




(lx, = say. 


Then 


But j"_ .IF. - J 


Hence 


E(w) = 


(- 1)^** 


(1 _ pn-l-fS^pS+l 


_ r 

4- l)!(w - 1 - -S!)J_o, 

o = U 

= r {1 - (1 - /’i)" - dx, . 

j —00 

In a similar way it is found that 

(m)) = 2f p {1 - - (1 - F,)^ - (F, - J’*)”} dx, dx, 

J —oo J —00 

{E(w)}^. ..... 


. (9.67) 


var 


(9.68) 
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This equation was used by Tippett to obtain values of the variance for n up to 1000. The 
following values illustrate the general behaviour of the distribution :— 

fit p 2 


w 

Standard Deviation 

(approximate) 

(approximate) 

2 

0*853 

0*99 

3*87 

10 

0*797 

0*16 

3*15 

100 

0*605 

0*21 

3*38 

500 

0*524 

0*29 

3*50 

1000 

0*497 

0*31 

3*54 


Again it would appear that as n increases, the distribution of range diverges more and more 
from the normal form. 

The distribution function of the range in normal samples has recently been tabulated 
by E. S. Pearson and Hartley (1942). 


List of Standard Errors of Commonly Oc^curring Statistics 

9.22. In view of the general utility of the standard error it may be convenient to 
bring together at this point for reference a number of sampling variances and other results. 
Some of these have already been obtained in this chapter ; others are direct consequences 
of the formulae or methods developed ; and some will be proved later in the book. 


Mean, var (m\) 


where a is the standard deviation of the parent. This 


/f_2 ^ 
n n 

is true in particular for a normal parent. The mean is always estimated from the mean 
of the sample. 

Variance, var (mj) =For the normal parent var (ma) — Tables 

n n 

are given for this case in T.S.B. I *. These results are appropriate to the case where the 

variance is estimated from the sample variance. For numerical results for other cases 

see Davies and E. S. Pearson (1934). 


Standard Deviation, var (6?) 


For normal parent var (s) 


These 


(/^4 - / 4 ) 

. ^ JL’ VX XXV/X JLXJlMfX V »X / S * 

^7hU2 

are the values for estimates from the square root of the sample variance. See previous 
note on variance. 

Third Moment about the Mean, var (mg) == 

n 

6cr® 

parent var (m^) = —. The third and higher moments are always estimated from the 

moments of the sample. 

Fourth Moment about the 

96<r« 
n 


Mean, var (m^) 


()«8 


f*\ 


n 


For 


normal parent var (m*) == 


Coefficient of Variation, var (F) 


I" 

n 


p2 

var (F) ~ approximately 

jLn 


(Hl. 
\ ^ 






—^ ). For normal parent 

yWii/Wi/ 


V 2 

Tables given in T.S.B. I. 

An abbreviation for Tables for Statisticians and Biometricians, Part I. 




f / 


STANDA&D BUBOES OF COMMONLY OOCUBRING STATISTICS 226 


0^) 


; 5 ,. var (^i) 

6/Ji 




n ^ 


var 


n 


Tables given in T.S.B. I. The distribution is fairly skew for moderately large 


n and the methods of Chapter 11 provide better tests of as a measure of departure from 
normality. See 11»23. (The /9’s are defined in equation (3.65).) 

ft, w (ft) . - W- + Vi 

T.S.B, 1. 

Pearson Measure of Skewness (Equation (3.64)). Tables given in T.S.B. 1. Probably 
skew for moderate n. See note on /?i. 

Pearson Mode. Formulae and tables given in Yasukawa (1926), the results of course 
being only applicable to modes calculated from the Pearson formula (equation (3.62)), 
Distribution may be skew for moderate n. 

Coefficient of Contingency. See 13,14. 

Coefficient of Association. See 13.8. 

Tetrachoric r. See 14.28. 

Mean Deviation. General formulae not known. See 9.13. For normal parent 


var 




(Uni'^s Mean Difference. See 9.14. For normal case var (A^) 


( 0 - 8068)202 


Median, var -r: — - where is the median ordinate of the sample. For 
normal parent var {ni^) ^ ^ '' • small samples from normal population, tables 


( 1 - 2533)202 

n 

and formulae given in Hojo (1931). Results to higher order in n given by K. Pearson (1931). 

302 

Qiiartdes'. var (^) =- where y is ordinate at the quartile concerned. For normal 

(1-3626)202] 

parent, var {Q) - \ Results for small samples from normal population given in 

Hojo (1931). 

Semi-interquartile range, var (s.i.q.) 


quartile ordinates. For normal parent var (s.i.q.) 

Deciles. For the normal parent, variances are 

for deciles 4, 6 ' 

n 


— 7, ^ ] where y^ y^y are the 
4n\l^yl ^ 162/.2 Hy,yJ 

( 0 - 7867)202 


n 


3, 7 
2 , 8 
1, 9 


( 1 - 3180)2 02 

n 

(1-4288)202 

n 

(1-7094)202 

n 


A.S. 
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(1 - 


Range. See 9.21. 

Correlation Coefficient. See 14.10. For normal case var (r) = ^ 

is better to use Fisher’s transformation (14.18) or the Tables by David (1938). 
Coefficient of Regression, See 14.10 and 14.11. For normal case var (6i) 


But it 


af(l - p^) 




Standard Errors of Sums and Differences 

9.23. Suppose we have two variables which may or may not be independent. 

We have, if z is their sum, 

E(z) = E(xi) -f E(x^), 

or the mean of z is the sum of the means of Xi and Xz. If then we measure Xi and x^ about 
their respective means, the mean of z is zero and thus 

var z “ E{z^) = E{xi + 

=r E(xl) + 2E(xiXz) + E{xl) 

= var Xi + 2 cov (a^i, Xz) + var Xz. . . , (9.59) 

Similarly for the difference of two variables we have 

var z ^ var Xi - 2 cov (.r,, Xz) + var .x* . . . (9.60) 

In particular, if Xi and Xz are independent their covariance vanishes, for it becomes 
the product of the two means, each of which is zero. In this important case we have, for 
the sum, 

var {Xi + Xz) =- var Xi var Xz . . . . (9.61) 

and for the difference 

var {xi — Xz) ~ vai x, -f- varXz. .... (9.62) 

These results are of fundamental importance : the variance of the sum or difl'eronce 
of two independent random variables is the sum of their variances. Generally if 

2; = UiXi + QzXz + . . . a^x^ 

and the n variables are independent, 

var z = af var x^ + a\ var Xg + . . . var x^. . . . (9.63) 

In particular we have, for the sampling variance of the difference of the means of two 
independent samples, say and p\^ 

var {rn'i — pj) = ^ . . . . . (9.64) 

n I n z 

Pz and being the respective variances and n^ Uz the respective numbers in the samples. 


Example 9.10 

A random sample of 1,000 men from the North of England shows their mean wage 
to be 47 shillings a week with a standard deviation of 28 shillings. A random sample of 
1,500 men from the South gives a mean wage of 49 shillings a week with a standard de¬ 
viation of 40 shillings. Required to discuss the question whether the mean level of wages 
diflFers between North and South. 

The difference of the means is 2 shillings and we wish to know whether this is significant. 
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From (9.64), taking as usual with large samples the unknown variances to be those of the 
samples, we find 

4.02 

var (difference) = — + 

^ ' 1000 1500 

= 1*851. 


The standard error is thus 1*36 and the difference in means, being less than twice this 
amount, is hardly significant of any real difference. Had the difference been three shillings 
instead of two we should probably have concluded that the difference, being more than 
twice the standard error, was significant. 

There is an alternative approach to this problem which is worth noticing. Suppose 
we assume as our hypothesis under test that the distribution of wages in tJio two areas 
is the same. Then we may combine the sample figures to give a new estimate of the mean 
and variance in this distribution, e.g, the mean might be taken to be given by 


(1000 X 47) + (1500 X 49) 

2500 

= 48*2 shillings. 

In the first sample the sum of squares of deviations about the mean 47 is 

1000 X 28^ = 784,000, 

and hence the sum about the origin is 784,000 4 - (47® X 1000) ^ 2,993,000. Similarly 
in the second sample the sum of squares of deviations about the origin is 

1500 (40® + 49®) = 6,001,500. 


The second moment of the whole about the origin is then 


8^994,500 

2500 


= 3597*8, and hence 


the variance is 3597*8 — (48*2)® = 1274*56. We might take this as our estimate of the 
variance in the population and our problem would then bo : does the mean in one of the 
parts of the whole sample, say the first, 47 shillings, differ significantly from the mean 
of the whole, 48*2 shillings ? 

Now at first sight it looks as if this is a case for the application of (9.64). We have 
two means, 47 and 48*2, with respective variances 784 and 1274*56, and require to know 
whether the means are significantly different. But the samples are no longer independent, 
for one of them is part of the other, and a modified formula must be used. If the means of 

the separate samples are and the mean of the two together 

is given by 


ni in\ 4" 
rii 4 " ^2 


jt^Xi 4 ~ <^*^2 
4 - ^2 


The difference of m'l and this quantity, say is then 


1 ^ Zxi 4- -Sr* 
q = ^-Zx^ --—— 


^ _ 1 _ 


Zxi — Zx2 


1 Th 

E(q) =-- — --nifi'i - Utfii 

I “f" Tltj/tli 




Thus 




22S 


STANDARD ERRORS 


imd hence 

Since Xi and a:* are independent, this reduces to 

(n, 

^ —— «*. 

ni{n^ + n^) 

In our case 7ti = 1000, == 1500 and our estimate of /z, is 1274*56. The variance of the 

difference then becomes, on substitution, 0*7647. The observed difference is 48*2 — 47 = 1*2. 
Once again this is less than twice the standard error (= \/*7647 = 0*87) and again we 
conclude that the difference is not significant. 
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EXERCISES 


9.1. Show that the moan value of the variance is given exactly by 

V — 1 


- 

and that its variance is given exactly by 


var (m,) 


(" :^y 




1 ). 


+ 


Ml 


n 

Hence verify that the formulae of this chapter as applied to the variance of a sample 
are accurate to order 


9.2. In the height distribution of Table 1.7 it has been found that 

= G-616 

~ 0 207 
W 4 - 137-689 

Regarding the distribution as a random sample from a population which is approximately 
normal, show that does not differ significantly from zero (which, of course, must be so 
if the assumption of normality is to be maintained) and that mi has a standard error of 
about 4 per cent, of its value. 

9.3. Verify that the standard error of the first decile in samples from a normal popu- 

, . 1-709(7 

lation IS-. 

n 

9.4. In the distribution of Australian marriages of Table 1.8 it has been fomid that 
the mean is 29-4 years, the standard deviation 8 years approximately. The median fre¬ 
quency is about 63,150. Taking this distribution to be a random sample, show that the 
standard error of the mean is 0*015 years and that of the median 0*043 years. 
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9.5. If a series of random samples of different sizes is drawn from a population in 
which the proportion of members bearing an attribute A is nu, show that the variance of the 


proportions of A in such sets is 
in the samples. 


zxj) 

ir 


where H is the harmonic mean of the numbers 


9.6. Show that the sampling variances of the first four cumulants, as calculated 
from the moments, are given to order by 

1 

var 

n 

var Kjj = i(#<r 4 -f 2 k ^) 

var -=^ -| 9/^ 4^2 + 9/c| -f 6 k|) 

w 

var /C 4 = -(#<8 4 - -4- 48/C6K‘3 + 34/^^ + 12k^ tci -f 144:k^K2 + 24/<r|). 

?? 

9.7. If the variate range is divided into sub-ranges and the frequency of a large 
sample falling into the pth range is fp. show that 

-/.(l -4) 

oov (/„,/,) - 

and hence find expressions for the sampling variance of the rth moment about an arbitrary 
point. 


9.8. Show that in odd samples of n from a rectangular population of unit range 

1 

the sampling variance of the distribution of the median is given exactly by j- -y 



CHAPTER 10 


EXACT SAMPLING DISTRIBUTIONS 

10*1. The role of the sampling distribution in statistical inference has been indicated 
in Chapter 8. In the present chapter we propose to give an account of the main methods 
of finding such distributions when the population from which the sample was derived is 
specified. It will, as usual, be assumed that the sampling is simple and random. Thus, 
if the parent distribution is dF{x) the simultaneous distribution of n values .Ti . . . is 
dF{x\) clF{ot^) . . . dF{x^ ; and if 2 is a statistic 

2 : = z{x^ . . . ^n).(10.1) 

the distribution function of z is given by 

F{z) j • • • j .... (10.2) 

the integration being taken over the domain of the x's such that z(xi . . . x^) < Zo. 

Formally, (10.2) is the solution of our problem, which thus reduces to the purely 
mathematical one of evaluating certain multiple integrals or sums. The methods with 
which we are here concerned are fundamentally devices of various kinds to facilitate the 
integrative process. They may be classified into foui groups :— 

straightforward evaluation of the integral (10.2) by ordinary analytical processes 
such as a convenient change of variable ; 

(6) the use of geometrical terminology to effect the same object and to avoid cumbrous 
analytical formulae ; 

(c) the use of characteristic functions ; and 

(d) other analytical methods, including mathematical induction. 


10.2, As an illustration of the straightforward analytical approach, let us find the 
distribution of the sums of squares of ft variables, each of which is distributed normally 
with unit variance and zero mean. The joint distribution of the // variables is then the 


product of n quantities of type 




dF = ~ exp — l{x\ + + . . . dxi . . . dx„. . . (10.3) 

We require the sampling distribution of 

Z ^x\ ^ xl ... . . . (10.4) 

We have thus to evaluate the multiple integral 


dF 


f • • • exp (■ 

^ ^ {27iyi 


dxi 


dx^ 


over the domain of x’s conditioned by (10.4). 
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Make tke transformation to variables a, 0,, 


0„-i 


?= Z^ cos 01 cos 0 , . . 

. cos 0„_1 

Xt — cos 01 cos 02 . . 

. cos 0„_2 sin 0 „_i 

Xj = cos 01 cos 02 . . 

. cos 0 „_, sin 0 „_,+i 


= 2 * sin 01 

The Jacobian of this transformation is given by 

. . . xj 

3(2, 01, . . . 0„_j)’ 

71—2 

which is equal to 2 times the determinant 


(10.5) 


cos 01 008 0a . 

. CO8 0„_1 

cos 01 cos 0a . 

. cos0„_2 sin 0„_j . . . 

sin 01 

— sin 01 cos 0a . 

. cose„_i 

— sin 01 cos 02 . 

. cos sin e„_j . . . 

cos 01 

— cos 01 sin 0a . 

. cosO„_i 

*“ cos 01 sin 02 . 

. cos sin e„_i . . . 

0 

— cos 01 cos 02 . . 

. . sin 0 „_i 

+ cos 01 cos 02 . . 

. . cos . . . 

0 


Taking out common factors in columns we find that this determinant is equal to 


cos* 


61 cos^*^ ^ 6 


cos 6^-1 ^2 


1 

tan 01 
tan 02 

tan 0^_2 
tan 0^^i 


1 


— tan 01 

— tan 02 

— tan 0^^2 
cot 0,,^i 


— tan 01 

— tan 02 


sin 0„_i times 
1 

cot 01 
0 


cot 0, 


n-2 


0 

0 


0 

0 


and, on subtracting each column from the preceding one, the determinant is found to reduce 
to 008 ^“^ 01 cos^'^”’^ 02 . . . cos 0 n_ 2 * 

Thus our integral becomes 

f . . . cos’*"*^ 01 . . . cos 0„_2 ^ 2 : cZ0i . . . rZ0„_i . (10.6) 

J (27i)i 

The advantage of the transformation is that the limits of the variables are now much 
simpler, z itself can vary from 0 to 2 ; and the 0’s from 0 to 27i, Thus the integral (10.6) 
divides into a product of integrals, those in 0 being constant, and we find for our distribution 
function of z 

71 — 2 


F(z) 


e-*" 

Jo 


2 2' dz. 


(10.7) 


The constant k may be evaluated by integration between 0 and oo and we have 


fe- 

Jo 


k 

■■ k 2 ^r\ 


71“ 2 

dz 
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Hence the distiribution sought is 

dF = —1 _ c"** 2 ~ 2 ~ dz, 0 < 2 < 00 

a Pearson Type III curve. 


( 10 . 8 ) 


10 *3. The essential feature of the change of variables is the simplification of the 
domain of integration as defined by the limits of the new variables. In general, we usually 
take the statistic whose sampling distribution is being sought to form one of the new variables 
and choose n — 1 others in any way which may be convenient to the particular problem. 
Then, if J is the Jacobian of the transformation, namely 


J 


the integral (10.2) becomes 

F(z) = j • • • ■ 


d{jCi 

d\z, du 


o7 


n~ 1/ 


/M 


d(xi, 

3(2, Oi, 




dz d&i 


dO, 


n~l> 


(10.9) 


f(xj) being the frequency function of the parent and Xj being expressed in terms of z and 
the O's. The integration now takes place with respect to the 0’s, which can usually be 
chosen so as to vary between limits which are independent of z ; and thus the indefinite 
integral (10,2) is replaced by more easily calculable definit<^ integ/als. 

As always in such cases J is subject to an ambiguity of sign which must be determined 
so as to make the transformed integral positive. The validity of the variate-transformation 
depends on the familiar conditions governing the change of variable in a multiple integral. 
For example, it is a sufficient condition that the new variables and their first derivatives 
shall be continuous in the x’s and that J does not change sign in the domain of integration.* 
Some further examples will make the general type of investigation clear. 


Example 10.1 

To find the distribution of the mean of a sample of 91 values Xy . . . from the dis¬ 
tribution 


ciF 


dx 

7l{l + X^) 


— 00 ,r 00 . 


The joint distribution is 


and the statistic z is given by 


77 


dx^ 




. ( 10 . 10 ) 


nz = ^ Xj. ..... (10.11) 

7-1 

We have to integrate (10.10) over a domain of x's subject to < nz. Let us take new 
variables Xi Xj, Xq = Xsy . . . == and 


x^ ■= nz — — x^ -- . . . 

* See, for example, dolaValJ^e Poussin, Cemrs (^analyse tnfimUsimali 1926, vol. l,para. 285; vol. 2, 
para. 18. 
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Here J is evidently equal to the constant n. Our new variables Xi , . . may extend 
from — 00 to + 00 and the new variable z from — oo to 0. We then have 


"l-J 


n—l 

77 


dxi 


, (1 + + (wz — Xi — . . . - 

and the frequency function of z is given by the (n — l)-fold midtiple integral in aji . . . 
in (10.12). This integral may be evaluated by step-by-step integration. We have 
1 1 


. ( 10 . 12 ) 


(1 + :r»)‘{r* -f (a -'a:)=‘} {o* 4- (r + l)“}{a>“ + (r - 1)*} 


c 


2ax + r* — 1 2a^ 

+ --T . V -T 


2ax 


x^ + 1 


x^ + I 


+ (a — a:)' 


+ 


+_l 1 

r® + (a —' x)^J 


Whence, integrating with respect to x from — oo to + oo, we find on the right 
1 


{a2 + 1)^} 


a 


log (a;® + 1) — a log {r® + {a — a;)®} 


n 2 — 1 _ 1 '>■’ —— 

-|- (a® + r® — 1) tan*"^ x +-tan“^ ‘—- 

T r 


reducing to 


'( t ){a* + (r -f !)»} • 




. (10.13) 


we find that the 


Thus in (10.12), taking x ~ r == 1, a ^ nz Xi — . . 

(n — l)-fold integral reduces to 

r P 71 dx^ 2 

J^oo* ' * (1+x^^)~{2^'~-{- {nz"^~xT- . .T“~a;;j2)®}* 

Integrating with respect to ^n~i * • • successively, we reduce this eventually to 

7?® 1 

... (10.14) 

. (10.16) 


dF 


OO CO , 


7z{n^ + (Ttz)^} jr(l + z^) 

Thus the distribution of z is given by 

dz 

n{l +~z^) 

and is thus the same as that of a single observation. 

This is an interesting example of the failure of the Central Limit Theorem, the mean 
of samples of n failing to tend to normality for large n. The second moment of the distribu¬ 
tion does not exist. 


Example 10,2 

To find the distribution of a linear function of 7i variables a^i . . . a:^ where x^ is dis¬ 
tributed normally with zero mean and variance v^. 

Let the linear function be 

2 = a^x^ + . . . + a^x^ .(10.16) 

Then by a transformation we have 

z == .(10.17) 

and Sj is now distributed with zero mean and unit variance. Our problem is thus equivalent 
to finding the distribution of a linear function of variables each of which is normally dis¬ 
tributed with zero mean and unit variance. 
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Consider a transformation of type 

Cl = 4" likt -4- . - . + IfJ^n 1 

fa = + ^*£2 + . . . 


n J 


. (10.18) 

• • I 

Cn ~ Pi^i 4- Pi ^2 4- . . • 4- 
and let us determine the Z’s . . . ^’s such that 

¥ + m'i^ + ■ ■ ■ Pi^ = 1, alii "1 <,0 jgv 

Ijljc + 4 - . . . pjPk = 0, all j, Jcy j ] ' ' * V ' ; 

This can always be done, for the conditions impose only n + \n{7i — 1) conditions on the 
71 ^ constants. 

We have then 

w n 

— (Zifi + . . . + -f . . . + (Piit 4- . • • 4 Pn^n)^ — 

in virtue of (10.19). The joint distribution of the f’s is by hypothesis 

-i-, exp (- 
{27t)i 

= exp (- . • • .(10.20) 


where 


(2^)*^ 

,/ = 




1 

aci 

I 


1 . 


The determinant -j is then, from (10.18), 

u 

ll 12 



ftii 

1 

7712 . . . 

rrin 


1 • 

'Pi 

P2 • • 

Pn 

equal determinant 


1 

h 

mi ... 

Vi 


h 

m2 . 

P 2 


In 

m,, . . . 

Pn 


we find, in virtue of (10.19), that the product is 

I 1 0 ... 0 

0 1 ... 0 


0 0 


1. 


Thus 


± 1 and (10.20) becomes 


exp(--^2’C*)77df. 

C2n)i 


. ( 10 . 21 ) 
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Now the may vary from — cjo to oo, and if we require the distribution of one of the 
f’s, say Cl ( = hCi + . . . ^wfn)» we have to integrate over all values of f such that 
< Cl* This is equivalent to a range of Ci from -*■ oo to Ci and of the other f’s from 
— 00 to + 00 . Thiis the integral of (10.21) becomes the product of (w —• 1) definite integrals 

each equal to I dC = and the integral I dC, and hence reduces to 

J —00 J —CO 




( 10 . 22 ) 


In other words, C is distributed normally with unit variance and zero mean. C is an 
arbitrary linear function subject to the condition that = 1. Referring to (10.17) 
we see that the slightly more general linear function z = will be distributed 

normally about zero mean with variance Ea^Hp for then has coeflSicients 

condition El^^ ^ I and is distributed with unit variance. 


The Geometrical Method 

10 , 4 , A considerable amount of cumbrous analysis may usually be avoided by the 
use of geometrical representation of the domain of integration. We may imagine the values 
Xi , , . attaching to any given sample as the co-ordinates of a point in an ri,-dimensional 
Euclidean hyperspace. The function dF{xi) . . . dF{x^) may then be regarded as the 
density at the point and the total frequency between Zi and will be the integral of this 
density (the v^eight) in a region lying between the two loci z(xi . . . x^) ^ Zx and 
z{xt . . . x^) ^ Z 2 , which in general will be hypersurfaces in the ?i-fold space, i.e. will 
themselves be spaces of (^ — 1) dimensions. The distribution function of z will be the 
total weight between the hypersurfaoe corresponding to 2 ; = — 00 and that corresponding 
to z ; and the frequency function will be the element of weight between the hypersurfaces 
z -* Idz and z + ^dz. 

Example 10,3 

Consider again the problem of Example 10 2. In the n-io\A f-space the density is 
given by 

„ exp (- 
(2jr)2 

The statistic z (— Ea^x^) determines a hyperplane 

z = Ea^yfvfi^ .(10.28) 

and we have to find the total weight between this hyperplane and the corresponding hyper¬ 
plane at — 00 , i.e. the weight on one side—^the “ lower ’’ side—of the hyperplane (10.23). 

Now EC^ is the square of the distance of the point Ci • • • Cn from the origin and is 
therefore unchanged by any rotation of the co-ordinate axes. Choose such a rotation 
which brings the axis of one variable perpendicular to the hyperplane (10.23), meeting it 
in Q, Let P be the sample point Ci • • • Cn O the origin. Then 

EC^ == OP* = 00* + QP^ 
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so that the density at P is 


1 

(2n)^ 




For variation over the hyperplane OQ® is constant and the integral of is thus a 

constant independent of OQ. Hence the frequency function of z is given by 

f{z) == 

k being some constant. 

But OQ is the distance from O to the hyperplane and is given by 


Hence 


OQ^ 


Za^Vj' 


f{z) = k exp 




i.e. z ib distributed normally with variance about zero mean. 

The reader will find it instructive to compare this example with the previous one. 
They are, in effect, the same thing expressed in different language. 


Example 10.4 

Consider again the illustration of 10 . 2 . The elegance of the geometrical approach is 
well brought out by the analogous derivation of the result there obtained. 

In fact, our density function, as before, is given by 

We require the distribution of the statistic z = OP^, and the density is obviously constant 
over the surface z = constant, that is to say the (?? — 1 )-dimensional hypersphere. The 
fre(iueiK*y function of z is then the integral of this constant density betwt^en the hyperspheres 
2 : and 2 + dz, i.e. is proportional to times the element of the volume of the hyper¬ 

sphere, which itself is proportional to the ?ith power of the radius OP. Thus we have 

(IF = ke- dz 

az 


= ke^^^ dz, 

giving, on evaluation of the constant, 

1 


22 Pi 


dz 


dF 


as before. 

Now suppose that the quantities Xi . . . while still being normally distributed with 
unit variance, are subject to p linear restrictions of type 


In the 7 ^-space the variables x will then be constrained to lie on p h 3 q)erplanes. The first 
will cut the hypersphere of constant density in a hypersphere of one lower dimension, also, 
of course, of constant density ; the second will cut this in a hypersphere of one lower 
dimension still, and so on. The result of the linear restrictions will be to constrain the 



t 
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variables to a hypersphere of p lower dimensions, and thus the distribution of z in these 
circumstances will be as before, but with n — p instead of n, i.e. 


dF — - \ -—2*<“-P-2)d:z . . . (10.24) 


Example 10,5. The sampling distribution of the mean and variance in nomml samples 
Writing x for the mean of a sample, we have, for the variance 

= -E(x — x)^ 
n 

= -Sx^ — x^. 
n 

In samples from a normal population with zero mean and unit variance the density at the 
point Xi . , , proportional to 

exp (— \Ex^) = exp {— l{ns^ + nx'^)}, . . . (10.25) 

Let us find the sampling distributions of s and x. From (10.25) it is seen that the density 
function can be expressed simply in terms of those quantities, and we then have to find some 
transformation of the volume element dxx . . . dx,^. 

In the 7i-space consider the unit vector whose direction cosines are —. . . — 

^ yn yn yn 

say OQ where O is the origin. If P is the sample point, let PM be the perpendicular from 

P on to OQ, Then the length of OM is 


Xx 

^/n 


+ + 

yn 


. . = x\/n, 

yn 


The length of OP is y'Ex^, Thus the length of PM is — nx^)^ = s\/n. 

The element of volume at P may be regarded as the product of an elemental increment 
in OM, equal to dx, and the elemental volume in the perpendicular hyperplane through M, 
In the hyperplane the contours of equal density, as in the last example, are hyperspheres 
of radius S'y/n centred at M, and conseqtiently the element of volume is equal to kdx s^^^ds 
multiplied by other elements which need not concern us since they are independent of 
X and 8, We have then for the element of frequency 


dP oc exp {—\{ns^-V nx^))8^ ^dxds . . . . (10.26) 

and this splits into two factors 

dPoce-*^^’dx .(10.27) 

dF oc ds .(10.28) 

Thus in samples from a normal population the distributions of mean and variance are 
independent. Equation (10.27) is equivalent to the result found in Examples 10.2 and 10.3. 
Equation (10.28) is new. We have 

dF oc ds^ 


and, on evaluation of the constant, 


dF = 


n~l 

n 2 






0 < « < 00 . 


, (10.29) 
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It is interesting to compare this with the distribution of the previous example. In the 
latter case we found the distribution of the sum of squares of the variables measured from 

a fixed point. In this case we have found the distribution of - th of the sum of the squares 

measu/red from the sample mean. A comparison of the form (10.29) with that of (10.24) 
shows that the distribution of variances is, except for constants, the same as that of sums 
of squares when subject to one linear constraint. 


Example 10.6. StudenVs ” distribution 
In the previous example we have 


Ji\/th 

8\/n 


OM 

PM 


= cot 


where (f> is the angle POM. 

5t 

If, then, we define a statistic z ^ z will be constant over »he cone obtained by 

s 

rotating PO about the unit vector, keeping the angle ^ constant. The distribution of z will 
then be given by determining the weight between the cones aefined by and (f> dtfy. 

Consider the intersection of these cones with the hypersphere of radius QP. They 
will cut off an annulus on the sphere whose content (the n-dimensional analogue of 
volume) will bo proportional to OP d<f).PM^'^^ 

~ 01^^^ siii’*^'“‘'^<^ dcf}. 


The density function is constant and proportional to e on the hypersphere and thus 
the total frequency between the cones will be proportional to 

8in^“2^ dif, d{OP) 

J 0 

oc 8in^'^‘'*<^ d<f>j 0 < <^ < TT. 


The distribution of 2 ; (— cot ^) is then given by 


dF oc 


k dz 

n ’ 

(1 + Z*)*" 


or, on evaluation of the constant, 

dF = ^ -.(10.30) 

frt _ 1 \ 

Since z is the ratio of two functions of the variables of unit dimension this distribution 
holds for samples from a normal population irrespective of the scale, that is to say, irrespec¬ 
tive of the variance of the parent population. 

The distribution is usually put in a slightly different form. 


Put t _ - V(» - I)*- 



3 ^ 

(10.30) then becomes 
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dF 


dt 




TtP I 


dt 


. (10,dl) 


. (10.32) 


where v ^ n — 

This celebrated expression is known as Student’s ” distribution after the iiom deplume 
of its discoverer (1908).* The distribution function may be evaluated from the incomplete 
J&-function, but special tables have been prepared. One such, due to Student ” himself, 
is given as Appendix Table 3. 


%/^Example 10,7, Distribution of the mean of samples from a rectangular population 
Consider now a sample of n values from the rectangular distribution 

dF ^ dx 0 < a? < 1. 


In the n-space the density function will be a constant ever 3 rwhere inside a hypercube 

0 < < 1, ^* *=■ 1, . . . n . . . . (10.33) 

and zero elsewhere. The unit vector will be the long diagonal of this cube. If P is the 
sample point (Xi . . . x^) and PM the perpendicular on to this diagonal, then, as shown 
in Example 10.5, OM = x^/n. Thus, for the distribution of x we require the element of 
weight (which in this case is proportional to the element of volume) between the hyperplanes 
X and X + dx ; and this is equivalent to finding the content of the hyper plane (its “ area ”) 
cut off by the various faces of the hypercube. The complication of the problem arises from 
the fact that as x increases this region changes its shape according to the number of edges 
of the hyperoube cut by the hyperplane. 

Consider the quadrants ’’ 


> rj 1 

= 0 or \y 


1 , 2 , 


. (10.34) 


whose comers are the corners of the hypercube. Any one of the corners may have 0 or 
lor2 . . . ornofits co-ordinates equal to unity and the rest zero. We divide the quadrants 
into (l^ + 1) sets according as the comer has 0, 1, , . . n of its co-ordinates equal to unity, 
that is, according as 

n 

is equal to 0, 1, ... A quadrant of the ith set may be called Qi, There will be 
different Let 8 be any point of Qo> ipoint whose co-ordinates are all > 0, 



♦ Strictly speaking, “ Student’s ” distribution is that of (10.30), the modified form (10,32) being 
due to K. A. Fisher. The latter form is therefore sometimes referred to as Fisher’s ^-distribution. 
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and let just 8 of its oo-ordinates be > 1. Then /S' will belong to jiist — 1, : 


and 80 on. Now if s > 0, 


Z^- 1)' 


(1 - 1)» = 0. 


(10.36) 


Hence, if whenever a point belongs to a Qg we give it a density (—1)* and then sum over 
all Q, the resultant density will be 1 or 0 according as the point belongs to the hypercube 
or not. 

Let the segment of the hyperplane 

2 = Z(x) .(10.36) 

lying in Qo have content V^(z). Then the segment lying in any member of (10.34) will 
have content VJ^z — r) which is zero ii r > z Further, the segment of (10.36) lying in 
any member of (10.34) will have the content 


■<:) 


V„(z - r) . 


. (10.37) 


where k -- [z]^ — the greatest integer less than z. 

To find Vn(^)f let be the projection of V^^{z) perpendicular to one of the axes, 

so til at 

Vni^) ==• V'wF„_i(z). 

Now r,,(;:) is the content of the /z-dimensional region bounded by (10.36) and the co-ordinate 
hyperplanes—a region whose base is therefore of content V^{z), The perpendicular from 

O to this base is Hence 

yn 




i i(v(/ 

’'"W - iri I - 


. (10.38) 


Since F 2 (s) — z\/2 rei)eated applications of this formula give 

V (z) = _ z"-^. 

’ (» - 1 )! 

Substituting in (10.37) wo find for the content of the region common to the hypercube 
and the hyperplane 


{n -- 1) 


‘>'0 


(z — r)"~* . 


. (10.39) 


for values of z between k and + 1. 
Since 
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the distribution of the mean m = is given by 


n 




Ic ^ + I 

~ <m < -, 

n n 


. (10,40) 

This is the required distribution. It is unusual in consisting of n arcs of degree (w — 1) 

1c 

in m, having (n — l)-point contact at their joins, that is at the points - = 1, 2, . . * n). 

7t 

The distribution is symmetrical since the hyperplane 2 : — constant is perpendicular to 
the long diagonal, which itself is an axis of symmetry of the hypercube. 

For particular values n = 2, 3, 4, (10.40) gives the following results for the frequency 
function :— 


n = 2 : 

4m, 


4(1 - 

w = 3 : 

27m 2 


27 


27 

(1 ~ 

n = 4 : 

128 , 
-TO*. 


m), 

- 3(m ^ 


(m^ — 4(m — J)3}, 


3 

128 
3 

±f{il 

' ^-(1” 


0 7n < I 

i < < 1 

0 < m < ^ 

i m f 
^ <m < I 
0 < m < I 
I <,7n < I 

I < 777 < I 

f < m < 1. 


If the frequency curve be drawn it will be found to resemble a normal curve in appear¬ 
ance. The distribution, of course, tends to normality as 71 increases in virtue of the Central 
Limit Theorem. 


The Method of Characteristic Functions 

10 . 5 . It has already been noted that the characteristic function of the sum of 
n independent variables is the product of their characteristic functions. This simple 
property enables us to find the sampling distribution of a wide class of statistics which 
are expressible as sums, and particularly of the mean. 

If we have a sample of n values from a population whose characteristic function is <^(<), 
the characteristic function of their sum is Thus the distribution function of their 
sum z is 

. . . .(. 0 , 41 ) 

and the frequency function is 

/( 2 ) 


. ( 10 . 42 ) 
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The following examples will illustrate the power of these results. 

Example 10,8. Distribution of the Mean for the Binomial 
The characteristic function of the binomial {q + pY is 

{q + pe^^y. 

The c.f. of the sampling distribution of the sum of n values is then 

{q + pe^^Y^ 


and that of the distribution of the mean f ~ of that sum) is 

f 

\q + pen ^ 


is 


/ ^\m 

\q + pen) . 


But this is the c.f. of the binomial 


1 


(q 1 jpr, 


(10.43) 


the interval being - instead of unity ; and hence this distribution is that of the mean. 


Example 10.9. Distribution of the Mean for the Poisson Distribution 




The characteristic function of the Poisson distribution whose general term is e ^ ^ 

exp — !)}• 

The c.f. of the mean is then 

exp nx{<^ — l) 

and hence the distribution of the mean is the Poisson distribution, whose general term is 




r! 


the interval being - instead of unity. 


(10.44) 


Example 10.10. Distribution of the Mean for the Normal Populaticm 
The characteristic function of the normal distribution 

1 


dF 


ix—n) * 

^ dx 


a\/(27i) 

is exp {— -f Up}. 

The c.f. of the distribution of the mean of n values is then 


exp nj- exp 


(10.46) 


This is the c.f. of a normal distribution with mean u and variance —, which is therefore 

n 

the distribution required. 



244 


EXACT SAMPLING DISTRIBUTIONS 


' Example 10.11. Distribution of the Mean for the Type III Populatim 
The characteristic function of the distribution 


dF j,--e a[-] 

Fiy) \a} a 


a > 0 


IS 


(1 — ita)y' 

The c,f. of the distribution of the mean of ?? values is then 


1 


~n) 


This is the c.f. of the distribution 

(IF 


1 ^ 71 dx 

--^ a I - J -- . 

r{y7i) \ « / ^ 

Example 10.12, Distribaiioti of the Mean for the Rectangular Population 
The characteristic function of the distribution dF = dx is 


(10.46) 


f 


e^^dx 


The c.f. of the mean of n values is then 


it 
a 

^ l\n 


tt 

n 


, and the frequency function is thus 


1 


lUle^ — 1 
^ n > 


di. 


(10.47) 


This integral is everywhere holomorphic and the range of integration may then be 
changed to the contour V consisting of the real axis from *— oo to - c, the small semicircle 
of radius c and centre at the origin, and the real axis from c to oo. Thus 

%i 


fi^) = 




jIj 

nj 


dt. 


, (10.48) 


Now 


J dz = 0 if g'> 0 


fin—X 

== — 2ni^r ^—if gr < 0. 


(« - 1 )! 

This may be seen by integrating along a contour consisting of F and the infinite semi¬ 
circle above the real axis if gi > 0 and below it if gr < 0. 
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Substituting ii?i (10.48) we find 

(- 1 ) 


/(*) 


Li^f i:(- 
271 Jr Kj) 


(- 1 ) 


(n - 1)! 


n —1 

T)! ^ 


(-1)^1 


{ i-r 


y «%wjr 

This, with a few changes of notation, is the same as (10,40). 

10,6. General expressions may also be derived for the distributions of geometric 
means and the moments about fixed points. 

In fact, if 2/ = log x, the characteristic function of y is 

a(0 r { x^^dF. 

J -CO j 

The distribution of the sum of n independent values of y, say nz, is then given by 


1 1 _ p-%tnz 


dt 


. (10.49) 


and the distribution of the mean is that of z. But z ™ log u, where u is the geometric 
mean, and hence the distribution of u may be found. 

The frequency function, when it exists, is 

f(nz) =- — dt, 

__co 

Similarly the characteristic function of a power of the variate, say is given by 


«'>=1' 




and thus the distribution of the rth moment, say z, by 


/*«> _ 1 

F{nz) - i!’(0) = — - di 

j —Qo d 


. (10.50) 


Example 10,13. Distribution of the Geometric Mean in Samples frorn a Recfangukir Population 
If the population is 


dF - - dx 
a 


0 X a 


the characteristic function of log .r is 

dx 
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The frequency function oi u = S log x is then given by 


2 wJ _» (1 -H it)”- 

1 in log a — u) 

- I —-(if 

(1 + ^t)” 


n log a — w > 0. 


This integral may be evaluated in the manner of Example 10.12 and we find 

(n log a — u)” -1 c-C 


/(«) 


r(n) 


whence, putting z — c's we find for the distribution of the geometric mean z 

,, , n''z”-W, a\”-^ 

® ij .... 


(io.r>i) 


Example 10,li. Distribution of the Second-order Mo7nevt about the Populutiou Mean in 
San}pies from a Normal Population 

If the distribution is 

1 

dF = —dx 
a\/{27t) 

the characteristic function of is 


J r 

a\/(27t)J 


e 2 <t« dx 


1 


(1 - 2aHt)^‘ 

The c.f, of the mean of n values, say W 2 > then 

1 




. (10.52) 


and the fre<piency function of this i,s 


i:( 


2 tin 2 

n J 


dL 


This may be integrated in the manner of the previous c^xample, or the result written down 
directly from the consideration that (10.52) is the characteristic function of the distribution 


dF -= 


7? 2 


2 n' chn 


. (10.53) 


a result which may be compared with that of Example (10.5), to which it is equivalent. 


The Method of IndncHon 

10.7, The distribution of the sum of two independent variates may be obtained 
directly without the intervention of characteristic functions. If Fx{Xi) and i^a(^ 2 ) 
the distribution functions, the distribution function of ~ x^ is given by 

foo rz-xt 

dF dF, (JF^, .(10.54) 

J ■— ca J —<X) 
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the domain of integration being that for which Xi + <z 

r«> r 

-LH-. 

= f Ft{z — X 2 ) dFz^ .... (10.55) 

J —00 

If, further, F is differentiable, the frequency function of 2 is given by 

/(2) = f /i(2 — iCa)/s .... (10.66) 

J —00 

fi and /j being the frequency functions of Xt and x^. 

(10.56) can be used to obtain successively the distribution of the sum of any number 
of variables whose individual distributions are known. If all the variables have the same 
distribution the general form may be suggested when the results for two or three variates 
have been worked out. Its correctness can then be verified by induction. The following 
examples illustrate the method. 


dF 


— 00 < a; < 00 . 


Example 10.15 

Consider again the distribution 

dx 

n{\ 4 ^ x^) 

By (10.56) the distribution of the H\im of two independent variables each of which has this 
distribution has the frequency function 

+ (J - .f.)(r|r.) 

This suggests the general form 

n 

7l{z^ + ?l2)‘ 

If this is correct, then the form for {n -f- 1) variables is 

1 


dx 


The result holds for n 


»“(»■"+ (z - + J) 

=. 

+ (n + 1 ) 2 }- 

1 , 2, and is therefore true in general. 


Example 10.16 

Ill Example 10.4 we found that the distribution of the sums of squares of independent 
variates is given by 

dF = -dz.(10.67) 

Suppose we had surmised this form from an examination of a few cases for low n. Let 
X be another variate distributed normally about zero mean with unit variance. We require 
the distribution of z + x^. 
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Let a:® = v. Then v has the distribution 

1 


dF 


€~*'’ dv. 


mi) 

Then, from (10.66) the frequency function of the distribution of u — z + v is given by 

r_. ism 

f (u-z)- 

I J —«o 


c-*“ 




2^r(j)ri 


)-*Z*(«-2) dz 


_ ^ii’ i^) „-|u^i(n-l) 

n+1 /m\® ^ 

^ *« ,/Xm-l) 


e-u 


2"V(”+-') 

which is the same as (10.57) with 7i ~f 1 for n. Hence the distribution holds generally. 


The Distributim of a Ratio 

10,8. Cases not infrequently arise in which wo wish to find the sampling distribution 
of the ratio of two statistics, z^. The problem becomes somewhat complicated when 
the divisor may be negative, but relatively simple in the contrary case. 

If Fi, jF, are the distribution functions of Zi and z^ and v = then for the distribution 
function of v we have 


(IF 


i:.r 


dF-i dFi dv 


= [ Fi(vzt) dFi dv, 

J —oo 

or, in terms of frequency functions, 

f{v) = f 2J',(Wa)/s(Z2) dz^. 

J —OO 


(10.58) 

(10.59) 


Exam'ple 10,17 

Consider again the distribution of the ratio x/s discussed in Example 10.6. Here x is 
the mean of samples of n from a normal population and is thus distributed as 

nJT* 

dF oc e~ dx, 

s is distributed as 

ns* 

dF 00 e 

as we have found in equation (10.29). 
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Then the distribution of e = - is, from (10.59), a constant time 

8 


1 s.e 2®* e a(> ^ ds <x _ t _ 

(1+V2)lj 

which then gives us the distribution (10.30) on the evaluation of the constant. 

Eocample 10 . 18 , Fisltsr^s z-distribution 

Suppose we have two independent samples of rii and n, members respectively from 
normal populations with variances af and a|. The distributions of the sample variances 

61 and then 

dF oc e 0 < < 00 


dF oc e 2V 


0 ^ 6*2 00 


The distribution of the ratio < = — is then, from (10.59), given by 

Si 

/{f) oc £ s, exp (- (~ 




i, + n,-3 pii-2 ((g 


0 << < 00 


/rni^ ^ w V, 

V <yy 

This is usually expressed m a somewhat different form. Put 


(10.60) 


z = I log = i log - \lt\ 


i(fll 1).S2 


‘^ 2(^1 — 1) 


00 < 2 < GO 


We find for the frequency function of z 

/(n, l)e‘2* ' w. - ry(".^-2) - 00 <z <co 

\ c'f / 

or, writing Vj = iij — l and v, — — 1, and evaluating the constant term 

f(-\ — ’'i*”' ’'2*'* /I A i>l \ 

aAi ■>^\ ' (vy‘ • • ( -O 

V2’2; V <Ti ai) 

In particular, if erf == af we get Fisher’s s-distribution of the ratio of two variances from 


(10.61) 


a normal population 


/(^) -= 


I’A (v;, 

[ 2 ’ 2 / 


g2e _j_ »■) 


. (10.62) 


distribution function of z may be obtained from tables of the incomplete B-function. 
Social tables showing, for various values of Vi and v„ the values of z corresponding to 
F(z) = 0.09 and 0.95, have been prepared and are given as Appendix Tables 4 and 6. 



250 


EXACT SAMPLING DISTRIBUTIONS 


10.9. Up to this point we have been mainly concerned with the distribution of a 
single statistic compiled from the members of a sample which is random and simple* The 
methods may, however, readily be generalized to obtain the simultaneous distribution of 
several statistics. For example, if there are several statistics Zi, and the joint 

distribution of the sample values is represented by dF(a:i, . . . the character¬ 

istic function of the z’s is given by 

<^(<1, •••</,)=! • • • I + • • • + (a'j ■ ■ ■ ^n) • (10.63) 

and the frequency function of the ^’s (if it exists) by 

/(Zj, . . . z^) = • • • J ®*P(- • . • - ■■■ ip) 

dh ... dtp . . (10.64) 

Examples of the use of these results will occur in the sequel. 
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EXERCISES 


10.1 • Derive by the method of characteristic functions the expression for the sampling 

distribution of the mean of samples from the population 

in dx ^ ^ 

dF = -- oo <x < CO. 

7t(l -f- x^) 

10.2. Show that the distribution of the geometric mean g in samples of n from the 
Type ITI population 

dF — ,i-T— dx 0 < a; < 00 

i {p) 


is 


dF 


ngr^P-l 

F{n){r(p) 




i;<- »■* 







1 gnt “j 

^ r(t i)J/x=^^ 


10.3. 


(Kullback, 1934.) 

Show that the difference of two values drawn at random from the Poisson 


population whose general term is e is distributed in the form whose general term is 

rl 


T^(2A), where d can take all integral values from — oo to oo and T^{2?i) is Bessel’s 
modified function of the first kind of order d and argument 2 A. (Cf. Example 4.5.) 

(Irwin, 1937, Jour. Boy. Statist. Soc., 100, 415.) 


10.4. Show that the distribution of the mean of samples of n from the Type II 
population 

dF CO — xy^~^ dx ^ > 0, 0 < jr < 1 

is given by 

h (f\Y 

^ J-oo 

where J^(z) is the Bessel coefficient of order r in z. 


cos (nxp) dp, 


(Irwin, 1927.) 
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10.5. Show that the distribution of the geometric mean of n variables, one from e»oh 
of the populations with frequency functions 

”-i~) 

is the same as the distribution of the arithmetic mean of n independent variables distributed 
in the first of these forms. 

(Kullback, 1934.) 


10.6. Show that the difference of two variates, 2 j, each of which is distributed in the 
Type III form 

€r^x^~ ^ 


ilF 


has the frequency function 




np) 

/f-ixt 


dx 


-00 (1 + 


dt 


2p-^ 

2-2—r(p)r(i) “ 

where KJjx} is the Bessel function of second order and imaginary argument. 

(K. Pearson, Stoufler and David, 1932, Biometrika^ 24, 293.) 


10.7. If a frequency function is given as the sum of a number of terms of the Type A 


senes 


/(,) _ + ... + 

show that the sum S of 7 i indepeuident variates has a frequency function 

-»(«'{' + + ■ • ■ >«(§)} 

where 27 o\^7i and 


711 




^ . . . Vfe!(iV — P3 . . . — 

the summation being taken over all values of the v's for wliich 

Svg + 4^4 + . . . -f- kiffc ~ J* 

(Baker, 1930, Ann. Math. Statist., 1, 199.) 

10.8. A theorem of Cramer’s (1937) states that if two independent variables, and 
a?a, with finite mean values, distribution functions Fi and JP® and characteristic functions 

^ 1 , <f >2 are such that i^a(O) ~ 0, so that x^ is non-negative, and f converges, then 


Ji 


the distribution function of v = is given by 

Xz 


Flv) = if ~ dt 

^ ^ 23tJ_„ it 
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and the frequency function, if it exists, by 

/(«) = hit)U- tv) dt. 

Use this result to obtain the distributions of Examples 10.17 and 10.18. 

10.9. Show that the ratio of two independent normal variables has frequency function 


f{v) = 


1 m^al + 


exp 


\ ^ orf + alv^ 


V{27i) (al + alv^)i 

where Wi, at are the mean and standard deviation of the first variate, mg, a^ those of the 
second variate, and it is assumed that is so large compared with a^ that the range of 
the second variate is effectively positive. 

mt — nizV 
{al + cr|v2)4 

variance. 

(Geary, 1930.) 


Hence show that is normally distributed about zero mean with unit 


10.10. Show that the ratio of two independent variables distributed as 
dF cc e <^x < oo 

(IF cc e'~ \x — 0<Cw2 < oo 

has a frequency function 

f (pt - l\fv \ 


f{v) 


(Pl 



(pt ~ 

V 1 )\vJ(\ + yjf 

\ 7s, 


1 


'^\(v^\Pi{Pi + I)!"'-'' 


P2 

{Pl - 1)' 72 





(pi — 

V 1 /W^l 


y,rY'-+‘-i 

rJ 


-I- 


where ^ = mj — m^v, (This includes Fisher’s sj-distribution as a particular case.) 

10.11. Show that the ratio of two variates , where Xi is distributed normally 

X 2 

with mean nti and variance a^ and the second like a standard deviation in normal samples, 
i.e. with distribution function given by 

dF a — mj)^ ds 0 < 7^2 < ^ < co 

has a frequency function given by 

- L.f;. 

1 i\a^f( 


fiv) 


yPe 2<7* 

a^(2n)r{p) 


vi&r{p +’4-^) ] 




where ^ = mi — m^v. 

(This includes “ Student’s ” distribution as a particular case.) 
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APPROXIMATIONS TO SAMPLING DISTRIBUTIONS 

11.1. In the previous chapter we have considered methods of deriving sampling 
diat^ributions in an exact form when the parent population is completely specified. Those 
methods are not applicable when the parent is not completely knovm, and they may in 
any case lead to results which are difficult to apply in practice, e.g. by yielding an integral 
which has not been tabulated. In such cases we can frequently deal with the problem 
by finding approximate forms for the sampling distribution, particularly by ascertaining 
its lower moments and then fitting a tractable type of curve such as one of the Pearson 
class. 

A procedure of this kind has, in fact, already been considered in Chapter 9, wherein 
it was seen that approximate expressions could be derived for the first and second moments 
of sampling distributions in terms of the lower moments of the parent. When the sampling 
distribution tends to normahty this, in effect, solves our problem, for the first and second 
moments determine a normal distribution. The methods of this chapter are really develop¬ 
ments of this idea. We shall discuss exact methods of finding the moments of sampling 
distributiofia in terms of parent moments. Our results are important not only on their 
own account, but in giving an accurate method of judging the degree of approximation 
of the expressions for large n discussed in Chapter 9. In particular we shall bo able to take 
up some points which had to be left on one side in that chapter—e.g. the rapidity with 
which some functions of the moments such as \^hi approach normality. 

11.2. It is as well to recall that there are three diffei*ent typos of moment concerned 
in the investigation : (a) the moments of the parent population, {b) the moments of the 
sample and (c) the moments of the sampling distribution. They will be referred to as 
parent-moments (parameters), sample-moments (moment-statistics) and sampling-moments 
respectively. Similarly we shall consider parent-cumulants, sample-cumuIantB and 
sampHng-cum ulants. 

11.3. In Chapter 9 we obtained the exact results 

Eim'r) = fi, 

var (m,) = E(m, - - ///) 

and noted that formulae for sample moments about the mean were more difficult to obtain. 
Although we shall later reject this approach in favour of another, it is instructive to consider 
what happens if we try to generalize the procedure of that chapter to our present problem. 
Suppose, for example, we are interested in the sampling distribution of the variance. The 
above equations give us the first two sample moments of the second moment about an 
arbitrary point. For the first sample moment of the variance we have 

jS(m,) = e\^Z{x*) - j-i 7 (ir) 

In 
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=. J? 

IZx^ 



n 

— 1 / 71 

= - 

-/^2 


71 

n 

- 1 

~~ — 

-(Wg. 

n 


n 






> 1 ^ 


j ^ h 


( 11 . 2 ) 


This is exact and may be compared with the approximate expression given by the methods 
of Chapter 9, viz. : 

E(m^) =- //,.(11,3) 

We might then proceed to find the second, third . . . sampling moments of the variance 
and thus obtain more and more information about its sampling distribution. For example, 
we have for the fourth moment 

-i + . . (11.4) 

We can then find the expectations of the individual terms by an easy extension of the 
mctliod already used. We (‘xpress any power in terms of products of the type E(xf' Xjf . . , xf) 
when jy^-k 7 ^ ; tlie mean value of such a product, the x*8 being independent, 

is n(r<, — 1) . . . (n — I . . . //p. Without loss of generality we may take our 

origin at the mean of the parent, so that = 0 and other moments are those about the 
mean of the parent. The rest is mere algebra. For example, for the first term in (11.4) 
we have 

mx^)y = (X? + cri + . . . xj)^ 

~ f 4:£xj^XjJ^ + QZx/xf^^Xi^ + + Zx^^xj^^x^x^^ , (11.5) 

The numerical coefficients require a little watching. That of Xj*Xj^^, for example, is 3, not 
6 as in the multinomial expansion of (a:f + • • • because j and k can be interchanged. 
The mean value of (11.5) is then 

//g -f 4^}i{n ™ l)/i«//a -i- Qft(n — l)(?i — 2)//^//^ + 3n(w — l)//f i n(n — l)(n — 2)(n — 3)/4* 
A similar evaluation of the other terms in (11.4) leads eventually to the result 

jE7{m|) = ■+~ — 24ju,/y, — 16//| + — 30/t^) 

— — 40//,//, — 96//,//, — 54//j[ + 336//,//! + 628//|/*, — 306//J) 

+ -^(6//, — 96//,//, — J76//,//, — 102//J + 924//,//| 1232//^//, — 1044//2) 

— ~(4//, — 88//,//, — 160//,//, — 95//! + 1050//,//! + I 36 O// 3 //, — \iQ5fjt\) 

+ - '^‘e//,//, - 35//2 + 420//,//| + 560/4//. “ 630//*) . (11.6) 

11.4. Systematic investigations of the sampling moments on these lines (though by 
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a somewhat different method) were carried out by Tschuprow (1919) and, for the particular 
case of the variance, by Church (1925), who corrected some misprints in Tschuprow’s results^ 
Unfortunately the resulting formulae are exceedingly complicated—^the above is one of 
the simpler cases—and are obviously unsuitable for practical work. 

It then began to be appreciated that their complexity might be due to the use of a 
special type of symmetric function of the observations, namely the moments, and the 
question arose whether other functions might have simpler properties. Thiele had already 
introduced the parameters which arc now known as cumulants, and had defined some 
statistics which were the same functions of the moment-statistics as the cumulants are 
of the moments. He also gave some expressions for the sampling cumulants of these 
functions. In 1D28 0. C. Craig developed this work and gave a number of further results. 
Even these, however, were sufficiently complicated and were reached only after some 
labour, and Craig himself remarked that “ it rather seems that the best hopes of effectively 
further simplifying the problem of sampling for statistical characteristics lie either in the 
discovery of a new kind of symmetric functions of all the observations ... or in the 
abandonment of the method of characterizing frequency functions by symmetric functions 
of the observations altogether.” 

About the same time R. A, Fisher discovered such a new kind of symmetric function, 
the ^-statistics, and his remarkable paper of 1928 forms the basis of nearly all subsequent 
work on the subject. The new statistics have the valuable property of yielding particularly 
simple sampling formulae which can be obtained directly by combinatorial methods, obviating 
most of the algebraic labour inherent in the older methods, 

Seminvariant Statlsticft 

11.5. It will be observed that equation (11.6) does not contain the parent-mean //i., 
In deriving it we took an arbitrary mean at the parent mean, which simplified the algebra 
to some extent. The independence of E{m\) of this parent mean is, however, not due to 
this accidental circumstance. In fact any transformation of the variate from one origin 
to another leaves unchanged, for ~ 2 J(x — m\Y and the transformation increases 
each X and m\ by the same amount, leaving their difference unaffected. Consequently 
if is independent of tlie location of the origin, so must be its sampling moments. Thus 
our sampling formulae are very much simplified if we use statistics which are independent 
of the origin. In equation (11.6) there are terms corresponding to /ig, 

If we had to take account of possible terms in there would be additional terms such as 
aud so on, our formula containing 22 types of term instead of only 5. 

11.6. A statistic which is independent of the origin of calculation is said to be semin¬ 
variant. The moment-statistics about the mean are seminvariant. We now consider a 
second family of statistics (^ ” 1, 2, . . .), symmetric in the observations .Ti . . . 
such that the mean value of is the pth cumulant, i.e. 

.(11.7) 

Note first of all that kj^ is uniquely determined by this definition ; for if there were 
two functions k^ and obeying (11.7) their difference would have a zero mean 

value. But this difference is itself a symmetric function and can therefore be expressed 
as the sum of terms Ux^ ©tc., and hence its mean value is a series of terms each 
of which is a product of moments. The vanishing of this series would imply a relationship 
among the moments which is impossible except perhaps for particular parent populations. 
Hence kp — k'^ must vanish identically and thus ^ k'^. 
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Secondly, note that the are in fact seminvariant, except for ki which is equal to 
the mean itself. In fact, we have by Taylor’s theorem 

kp(.a-i \-h, Xt + h, . . . x„ -f ^) = kj,(xi, a-j, . . . xj f ^^Dkp(Xi, x^, . , . xj 

-+ ~^D%(xi,Xt, . . . a-J f . . . . ( 11 . 8 ) 

where 

/ + / + . . . I- ^ . 

uX j OX 2 vX 

Taking mean values, and remembering that itself is independent of the origin, except 
for K-j, we have 

.... (11.9) 

Thus E{D]c^) and other terms on the right vanish separately, for (11.9) is an identity in h. 
In virtue of the remark above, this implies that Dkj^ — 0 , ~ 0 , and so on ; and hence, 

from ( 11 . 8 ), 

k^,{x^ Y h, Xi h, . , . X,, h) kp{x,, x^, , . . xj, 

i.e. kj^ is seminvariant. The exception to this rule is ki which has as its mean value ki = rUi 
and thus 

A-, = yl(x) .( 11 . 10 ) 


11.7. We noM^ f)roceed to find explicit expressions for the ^-statistics in terms of 
the observations x^ . . , x^^, By definition k^ is degree p in these observations (for is 
of order p in the moments, that is, the sum of the orders of the moments comprising any 
term in Kj, is p). We may then write 




^ J7i-f 1 




+?T#f 


'’')A(p,’- 


( 11 . 11 ) 


where the second summation extends over all the ways of assigning the 

subscripts (including permutations) from the n available and the first summation extends 
over all partitions of the number p, . . . p/")- A{p{^' . . . pA'^) is a number 

depending on the partition. 

We have 


and define p by 


Pi^i i P3^2 f . . . 4 p^.^^ ^ p . 

TTj f- TTa I . . . -i - p. 


. ( 11 . 12 ) 

. (11.13) 


On taking mean values of (11.11) we have, since the .^’s are independent, 


.... (11.14) 

where B is the number of ways of picking out the p subscripts from ?/, permutations allowed, 
and is therefore equal to n{7i 1) . . . (a — p f 1) = 

Now from equation (3.31), we have 


... A'-'Y 

\piy \p^} 


y. (_ ly-^p _ 1)! 


7ti! 


. (11.15) 


A.S. 


b 
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the summation extending over all partitions subject to (11.12) and (11.13). On identifying 
oorresponding terms in (11.14) and (11.15) we find the values of the A’s and on substituting 
in (11.11) obtain finally 


_pir(- iy-^(p - 1)1 j^. . 

^ ""(Pi!)”‘ . . . 


(11.16) 


the explicit expression of in terms of the x's. 

We may notice an important simplification of this expression which is crucial in a 
discussion of the sampling properties of the A;’s. Apart from factors in p and n a typical 
term in (11.16) may be written 

where, it is to be remembered, permutations of the subscripts are allowed. There will 
be a term of this type oorresponding to every partition of p into jt’s and of p into p's. 
Consequently we may write 

i:, = ■ { 11 - 17 ) 


where there is a term in the second summation corresponding to every possible way of 
assigning the subscripts. In this assignment subscripts are regarded as distinct entities. 
For example, if from the 7 i subscripts we choose pi to be 1, pi to be 2, . . . p^ to be -f 1, 
and so on, there will be as many different terms as there are ways of choosing pi from 
the Ts, and so on, i.e. 

— nii«^ 

• • • (Ps)’'‘^i' • • • V ■ ■ ^ ' 

In fact, (11.16) is a condensed form of (11.17) in which all the terms leading to tlie same 
.r-product are added together, their number being given by (11.18). 


Expreyssion of k-Stahstics m terms of Symmetric Products and Sums 


11.8. Writing 

[Pi"'pf"" • • • i -y , , . A I . . (11.19) 

so that, for instance, 

[ 21 ] 

[2*1] = 


we see that the mean value of [pi"‘ . . . p/*] is • • • Pp”'- We can then write down 

the k’B in terms of the symmetric product sums [p”] at once from the expressions of cumulants 
in terms of moments. For instance, from (3.33) we have #f, = ^3 — + 2j«, * and 

hence 





3[21] ^»] 


_ [3] _ 3[21] ^ _J[13 

n n{n — 1) n{n — l)(n — 2) 


. ( 11 . 20 ) 
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a result which, of course, can be obtained directly from (11.16). In fact, there are three 
partitions of S, (B), (21), and (1®). From (11.16) we then have 

1 ^![3] 1)1!3![21] (^. 1)22!3![13J 

" 7i(n - l)2!l!l!l! ^ n(n - l)(n 2)(1!)33! 

^ [3] 3[21] 2[P]_ 

n H{n 1 ) n(n — l)(n — 2) 

as before. 

It is, however, more useful for practical calculation of the A*-8tatistics to express them 
in terms of the power sums defined by 

s.^Six^). .(11.21) 

This can be done by expressing the product sums (11.19) in terms of power sums (a pro¬ 
cedure which may be facilitated by the use of tables of symmetric functions) or directly 
as follows :— 

Assume 

Since Eik^) = /I 3 we have 

jUs = a„E{ff 3 ) -f aiA>iA2) -t 

Hence, for moments about an arbitrary point 

/i3 - 3/4/^i + 2/i\^ =ao(n/^3) + 

t- a 3 {nii^ + 3w(n — l)/4/<i 4 — l)(i^ 2)^i^}, 

from which we find, identifying coefficients, 

1 = ri{a^ + Gfi f «2) 

— 3 n{n — ])(ai + Bc/^) 

2 - n(n — l)(w — 2)a2 

whence, solving for and a 2 , we find 

k^ = 3wa*2A‘j -j' 2 aj). 

11.9. The first eight ^-wstatistics in terms of the power sums are as follows:— 
n 

- * 1 ) 

^4 -- ^4){(w.* 4- n^)St —• 4 («® + n)a^i — 3 («* — n)«| + 12n«,s‘i — (isj} 

hi — + 6n®)St — 5(n® + — 10(n® — + 20(74® + 2n)s3af 

+ 30(74® — n)s\8i — 607tfi,Sj 4- 24«5} 


( 11 . 22 ) 
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]cq = 16«^ -I- llri® 4w/^)6fe — + \ \n^ — 4:n)tS^8i 

— 4 - 4'/?.), 946*2 — 10(r<^ -- 2n^ + — 4'/?-)«v| 

+ 3i){n^ + 9 /i 2 4 - 2 r 06 * 46 *f + 120(n3 — n)s:,s^i + 30(n» — + ^n)sl 

— 120(n2 3n)s^s^ - 270(^2 — n)4s-f + 360 m52,s| ~ 120.S-J} 

Jc^ ~ + 119??^ — 42yi-^),s*7 — 7(w^ f- 42??^ -|- — 4:2n'^)sQ8i 

— 2l{n^ -I 12^4 - 31w» 4- „ 35(,^6 5^3 „ 

+ 42(7?^ + 27n^ -f 44/^2 __ i2w)^#5cSj + 210(71* + 671^ — 137/2 4- 6^).94,92.91 
4- 140(7/.* 4- rm^ — 67i)t9|/?i 4“ 210(7?.* — 3??2 4- 27^2)^^352 

— 210(?72 4- 13/72 4- 677)6*— 1200(772 4- 7/2 2/7),9362.91 

- 630(7/2 ~ 37/2 27?)t93t9i + 840(7?. * 4- 47/)6‘36f 4" 2520(/7 2 - 7/).9 |s‘J 

— 2520ns^8’l + 7206J} 

it, = -I- 99»i» -h 757tiS + ]41r(« - 398/i.» 4 120«2),,, _- 8(«« f99«s + 757w< 

+ 141^3 -- 398«-“ -h 120w)«,.Si - 28 (m» + :i7n'- - 39w« - ]r,7w« 

4 278w“ — 120«K«2 — 56(»® 4 9r4 — 23fl® 4 lllw,® — 218«2 4 120«)s,s, 

— 3r,(>i« 4 71^ 4 33«« - 121?t® 4 200w4 — 120rj.)*'| 4 r>6(w® f 68«‘ \- 369w® 
87/2 _ 6077)t9<j6‘i 4- 336(7/^ -4 2377* — 3177^ — 23//2 4- 307?)666*26 ’i 

4 560(7/^ 4 - 57/* 4- 5/7® 4- 5772 — 677)64.f3.9i 4~ 420(7/® 4 - 277* — 2577® 

4 46//® 2477).s*4.9!j 4- 560(77® — 4/?* 4- 1177® 20?/® + l2/?).sf^tS2 

— 336(//* 4- 38/?® + 997/2 — 18/7)6Vi — 2520(77* + 10//® --- 37//2 -4 6/7)6*4.926? 

— 1680(//* + 277® 4- 7//2 — 1077)636*1 — 5040(77* — 2//® - 7/24 27?)63626i 
63()(//* ~ 07/3 4 - 1177® - 077)6^ 4- 1680(77® 4" 17/7® + 127/)6*46j 

4- 13,440(/7® 4- 277® — 377)63626*1 "4 10,080(77® — 377® + 277)6ij6? 

-- 6720(//2 4- 57/)636? - 25,200(77® - 77)6|6*? 4- 20,1607/62.9? - 5040.9?} 


In particular, we have 

=r mi 

k 2 — —:: 7/7 2 

7/ — 1 


ks 

k. 


(7? - 
(77 - 


7 ?^ 

l)(n - 2 f^ 

7/ ® 

!)(// ->)(// - 3) 


{(« ^ l)r//4 


1 


I 

I 


3(// 1)7//®} I 


(11.23) 


expressing the k's in terms of the moment statistics. 


11.10. There is a well-known theorem of symmetric functions which states that any 
rational integral algebraic symmetric function of rri . . . can be expressed uniquely, 
rationally, integrally and algebraically in terms of the symmetric sums 6^. It can thus be 
so expressed in terms of the A:'s, for from equations such as (11.22) the .s’s can bo so expressed 
in terms of the Ai’s. Thus an investigation of the sampling constants of any syinnietric 
fimction expressible in terms of rational integral algebraic symmetric functions can be 
translated into an investigation concerning the A^’s. 

To round off this account of the relationship between the Fb and the 6’s we may refer 
to two interesting operational properties. Write for the same function of the differential 
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d d 

operators ^, . ~— as is of the x's and for the same function of the operators as 

aXi 


Sj^ is of the Then 




1 


. ( 11 . 24 ) 


• ’ • ’^Pm) / 

where (pi . . . p„j) is any partition of p other than p itself ; and 

Methods of proof and applications of these results are given in the exercises at the 
end of the chapter. 


] ■ 


. (11.25) 


Sampling Cumulants of h-Stati^fics 

11.11. The problem of determining the sampling moments or the sampling ciimulants 
of X'-statistics is that of finding mean values of powers and products of those statistics. 
To any number a with partition there will correspond a moment 

. . . /O) .... ( 11 . 26 ) 

and a cumulanl/< the moments by the identit\ (cf. equation (3.54)) 


v/ 

I 






«s“') 


Xi 

! 



log 






(11.27) 


F"or (‘xanijile, the fourth cumiilant of will eoiTes]>ond to the fourth moment of k^y 
which is the mean value of k^. These quantities will be written ac( 2^) and //(2^), in accord¬ 
ance ^\ith (11.26). Again the cumulant k(H2) corresponds to the moment p(32). tiie mean 
value of or their covariance in their joint sampling distribution. Generally, in the 
simultaneous distribution of the ^’*s there will be a separate formula of degree a for every 
partition of a. 

Nonv the product . . . ka,^* is homogeneous and of total degree a in th(‘ .r's. 

Hence, when mean values are taken //(c/i®> . . . a^*) will be homogeneous and of total order 
a in the parent p's. Since the k's themselves are of liomogeneous order in the /^s it follows 
that . . . af^») is of homogeneous order in the /c's. Hence we g('t the first rule for 

the sampling of X’-statistics (which is true of seminvariants generally) • — 

Rule 7. consists of the sum of terms each of winch, except for con¬ 

stants, IS a product of parent /c\s of order a. 

For instance, /<-(2^) is of total order 8 and is therefore the sum of terms in 
Kj, and k\, Similarly k( 32) will contain a term in Kr^ and one in and no others. 
As seen in the next rule, no terms in ajipear (as again is true of seminvariants generally). 

Rule 2. No term in . . . ^/*) contains /c,, except k^(I) itself. 

This follows as in 11,5. The X-statistics are seminvariant and hence their sampling 
distribution cannot depend on the variable quantity /c^. The exi’eption occurs when we 
are dealing with the only statistic which is dependent on the origin, namely X’j, and here 
K'(l) KTi as is evidemt from the definitions. 


11 . 12 . We now enunciate and illustrate the rules by which the terms in k(Ui^‘ . . . 
can be found. As the proof of the validity of the rules is difficult to grasp until their nature 
lias been comprehended we defer a proof until later in the chapter. 
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To find the term in kj,/- . . . Kft,/-* in #c(ai*’ . . . a/*) consider the two-way away 

I 



. ( 11 . 28 ) 


(7 1 . . . 0^2 

where there is a row corresponding to every k in the term and a column 

corresponding to every part in Consider the various ways in which the 

body of the table can be completed by the insertion of numbers whose row and column 
sums are the respective b and a numbers ; e.g. if we are seeking the coefficient of /cg/cS in 
#e(4^2) we shall consider such arrays as 

2 2 2 h 2 3 16 

11.2 11 . 2 

1 1 . j 2 1.1 2 

4 4 2 ! 10 4 4 2 10 

Then the rules by which these arrays give tlie coefficients of are as follows : 

Rule 3. Every aiTay in which the numbers in the body of the array fall into two or 
more blocks, each confined to separate rows or columns, is to be ignored. 

For instance, in the foregoing example 

4 2 . 

2 

2 

4 4 2 ' 10 

is to be ignored, since tlie 2x2 block in the top left-hand corner has no row or column 
number in colninon with the entry in the bottom right-hand corner. 





Rule L Subject to the ignoration of terms enjoined by Rule 3, to the coefficient of 
inK-(u,^‘ . . . there will be a contribution corresponding to each way of 
completing the array (11.28). Such of these as do not vanish are composed of a numerical 
coefficient multiplied by a function of u. 

Rule 5. The numerical coefficient is the number of ways in which the column totals, 
considered as composed of distinct individuals, can be allocated to form the array concerned, 
divided by . . . pj. 

Rule 6. The function of n, called the pattern function, depends only on the configura^ 
tion of zeros in the array, not on the actual numbers composing it or on the row and column 
totals. The function is given by considering the separations of the rows into distinct 
groups or separates. 
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(i) With one separate there is associated the number », with two separates 

n{n — 1) , with q separates n{n — 1) ... (n — q + 1). 

(ii) In each separation we count the number of separates in which a particular column 

is represented by a non-zero entry. If in p separates, we assign the factor 

_ (- _ 

n{n — 1) . . , (n — p + ly 

(iii) This is done for each column. 

(iv) The various factors given by (ii) and (iii) are multiplied together for each separation, 

multiplied by the factor appropriate under (i) and the results summed to give 
the pattern function. 

Rule 7. Any array containing a row which consists of a single non-zero entry has 
a vanishing pattern function and is to be ignored. 

Rule 8. Any array containing a column which consists of^a single non-zero entry 

has a pattern function times that of the array obtained by omitting that column. 

Rule 9, Any array the non-zero elements of which consist of two groups connected 
only by a single column has a vanishing pattern function and is to be ignored. 


Example 27J 

As an illustration of these rules (which are not as difficult as thc'y look), suppose we 
seek for the coefficient of /<QKj in fc(4^2). If the reader will write down the thirty or so possible 
arrays with column totals 4, 2, 2 and row totals 6, 2, 2, he will find that the only ones which 
do not vanish are those of (11.29) and permutations of rows and columns with the same 
sum, namely 


2 

2 

2 6 

2 

3 

1 

6 

3 

2 

1 6 

2 

3 

1 * 6 

1 

1 

. 1 2 

1 

1 

. 

2 

1 

1 

2 

1 

, 

1 2 

i 

1 

■j " 

1 


1 

2 


1 

1 2 

1 

1 

2 

4 

4 

2 i 10 

4 

4 

2 

10 

4 

4 

2 1 10 

4 

4 

2 10 


(a) (h) (c) (d) 


3 2 1 I 0 3 3. 6 

. 1 1 I 2 1 . 1 I 2 

1 1 . , 2 .1112 

_ I „ i __ 

4 4 2 ' 10 4 4 2 I 10 

(e) if) 



With practice the reader will find it unnecessary to write down arrays such as (c), (d) 
and (e), which are merely obtained from (b) by permuting rows and columns, but for clarity 
at this stage they have been set out in full. There is one trap here to be particularly 
noticed. In array (6) the two columns summing to 4 and the two rows summing to 2 are 
different, and their permutations result in 4 different arrays. But in array (/), though 
the rows and columns are different, there are only 2 different arrays. 


Each of those arrays contributes to the coefficient required. Consider first of all that 
from (a). The numerical coefficient is ^ 2!li il)* ^ factor in 

brackets is the number of ways of allocating 4 individuals in the partition 2, 1, 1, similarly 
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for the second, and we divide by 2! since there are 2 members of the row totals the same, 
this being the only p factor. 

Under Rule 8, the pattern function is times that of 

n 


X X 
X X 
X X 

There are five separations of this, one of one separate, three of two separates and one of 
three separates. The contributions respectively under Rule 6 will be found to b(' 


n{n - !)(// 


n 



1 


n 


!)}{»(» -- 1)} " «(» 
r (-1)^2' -I r (- i|^2! I 
- 1)(« 1)(« ^ 2)J 


1 ) 

11 (n 


4 

\){n ~ 2)- 


The sum of these is 


72 


(/? 


/? 

l)ir^ 


2 ) 


and hence the contribution from array (</) in (11 .‘10) is 


(n - l)(n - 2)* 

Now for arrays (b) to (e), which have all tlic same numerical factor and the sanu' pattern 
function and can therefore be considered together. For any one the numerical tactoi is 


/ 4^ Y 2t yi 

V2'iU7vri7Vi^A7 


4S 


and that of tlie four together is thus 192. 

Under Rule 6 the jiattern function will d(‘]iend on the configuration 


X < 
X X 

X . y 


where X stands for a non-zero entry and a period for a zero entry. There are five scjiara- 
tions of this, one of one sejiarate, three of two separates, and one of three -^ejiarates. The 
contribution from the first is 

111 I 

7i - =~ 

}f )i n N- 


for each column has a non-zero entry in the separate. The contiibution from the three 
separations given respectively by isolating the first, second and third row will b(‘ found to be 


n(n 


r -' 

- 1)'^ 






1 



2/^ 

71 


3 


The contribution from the separation of three separates is 

2» 1 


71 {fi - 1)(7J - 2) 


_7l (?l 


!)(?/ — 2) n{ii — 1 ) 7i[v 


-1)J 


The pattern function is the sum of these three contributions and is thus 


_1 

{yi - iT^ 
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The contribution from arrays (/) and (gp) in (11.30) will be found to be ' . 

Hence, adding all the contributions together, we find that the coefficient of in 
k( 4®2) is 

72 192 , 32 _ 8(87n - 05) 

{n - 1)(7? ~ 2) — 1)2 (71 -- 1)2 (n V)2Y/r~~2y 

as shown in equation (11.62) below. 

11.13. Rule 10, The expression for any K(a^^ • • •) which contains a unit part may 
be obtained from that without the part by (1) dividing throughout by n and (2) increasing 
the suffix of one of the /c’s by unity in every possible way. 

For example, it may be shown that 


k(22) 


n N 1 


Hence 


K(2n) = '‘“+ 

/^2 fi(')i _ 1 ) 


/C(22r2): 


n'\7i — 1 ) ' n^(n — 1 )’ 


and so on. 


11.14. The rea(ier may be inclined to doubt whether this rather elaborate com¬ 
binatorial procedure represents much of an advance on the straightforward algebraical 
ap})roach considered earlier in tlie cha])ter. A few trials of the two methods in particular 
cases will soon convert him to the former. The division of the coefficients into a numerical 
factor and a [)attei‘n function greatly simjdifies the method and in fact all the functions 
likely to be required for practical pur]ioses have been tabulated by Fisher (1928) or can 
be derived therefrom by an iterative process given by Fisher and Wishart (cf. Exercise 11.11). 


Example 11.2 

To find th(' variance of tlie second moment statistic mg. 
From (11.28) we have 


Hence 


var /a 2 


C»*)’ 


k:( 22) consists of two terms, one in and one in k\. The only array contributing to the first is 


2 2 4 

2 2 4 
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with a numerical factor unity and a pattern function 


are of type 


2 

2 


The arrays giving the second 


If any entry in this were a 2 the row in which it appeared would contain only a single 
entry and hence the array would vanish. The only contributing array is therefore 


1 1 
1 1 


2 

2 


2 2 I 4 


( 2 ^ \2 1 

iTl!/ ‘2! ^ pattern function will be found to be 


{n 1) 


. Hence 


.( 2 ^) = + M 


var 


n n — I 




-(/<4 + 3/<l) -f ---/4 

n — 1 


{n - ir- , (3 ~ n){n - 1) 


As n becomes large this result tends to 

1 


n 


(//4 - pi), 


confirming the approximation given by equation (9.9). 


Example 11,3 

To find the third moment of /cj we require k{2^). This will be the sum of factors in 
^6, and k 2 - 

I'he coefficient of the first is For the second we have to consider the array 

1 1 2 I 4 

11.12 

2 2 2 j 6 

all others vanishing except the two equivalent partitions obtained when the column with 
the single entry appears in the first or second place. The numerical factor is then 


2! 
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Tke pattern function is — times that of 

% 


i.6. 


X X 
X X 

1 12 
is - - • The coefficient of is then 

n(n ~~ 1) n(n — 1) 

For the term in k| the only contributory array is 


1 1 
1 1 

2 2 


1 

1 

2 


3 

3 

6 


( 2 ! \ 3 1 ^ 

I • ^ pattern function - 

111!/ 2! ^ n{n 

For the last term we have to consider* the array 


- 2 


- 1)^* 


1 1 

1 . 

. 1 

2 2 


1 I 


2 

2 

2 


2 * 6 


with a numerical coefficient 8 and a pattern function 


we get 


(n - 1)2* 


(bllecting terms together 


k(2^) - 


12 /c 4 #c 2 ^ 4(n — 2) 
n{7i ~ 1) n(n 1)2*^ (rt 


1) 




This is also the value of the third moment /i(2^) jmeasured about the mean of the sampling 
distribution kj. We see that if the parent is normal the third moment reduces to 




i.e. is of order n indicating a rapid tendency towards symmetry. 


{n - 1)2’ 


Ejcamph HA 

Few things illustrate the usefulness of expressing the formulae in terms of cumulants 
and the power of the combinatorial method better than the simplification imported when 
the parent population is normal. In this case only terms in survive, all higher cumulants 
vanishing. 

As an illustration lot us prove that K{pq) “ 0 for normal samples unless p — g. 

The only term which can appear in K{pq) is and evidently, if 4 q is odd, even 

this cannot do so. If p f- ^ is even we have to consider the arra}^ 

2 

2 

2 


p q 
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Now if any entry in this array is 2 the array vanishes since the row concerned will contain 
only one entry. The reverse can only happen if all the entries are unity, in which case 
the sums jp and q must be equal. This establishes the result. 

Example 11.5 

Any containing n parts is of order For example, 

is of order 

To prove this result we have to consider only the pattern function. Consider the array 


a 

To the single separate there corresponds under Rule (> the function v 

Furthermore, no pattern function can be of greater order in n ; for in an array with more 

than one row, with q separates there is associated the factor •-t-, ... ^ where 

pi is the number of separates in the first column contaiiring a non-zero entry, and so (m. 
If there is more than one entry in the Jth column the factor must be at least of order 
and thus the pattt'rn function of order less than ; and if then* is only one entry 

in each column the order must be unless the function vanishes. Hence the result. 



11 . 15 . By the above methods Professor Fisher worked out the sarn])ling formulae 
for degree not greater than 10, and gave some of the 12th degree. The following are the 
results, with a number of corrections. 


Seroad Ic-Stailfftic 


k{2^) 


n n 1 


2 


k{2^) - r 




- 2 ) 


ti(n - ]) - 1)2 ^ (u — 1)2 

24 


-H , , 32(7/ - 2) S{4n^ - Ih/ + 6) , 

//‘^ — 1 ) n^(n — 1)2 - 1 )-^ 


144 , , m(ri ~ 2) „ , 48 

>/(// - I)- 7i{v 1)^ (n — 1)^ 


k(2^) 


/Cio ^ 40/Cs/<r2 I 80 (a? 2) 


71« 


- 1 ) ^ n^ti 1 ) 




40(5//2 — 12// + 9) 


//^(// 1)-^ 


KqK^ 


l(*>(At - 2)(G??2 12?/ t 7) ,, 

//»(// ~ ])« 


480 


//2(// - 1)2 


/Cfi/Cg 


■!“ -I 


320(4/7 2 _ s\7i -f 0) 4 80(2//2 — 7// }- 0) ^ 


7 / 2 ( 7 ? 1)4 




1280(// - 2) 
7/2(// ~ 1)3 

1920 


(11.31) 

(11.32) 

(11.33) 


K^K^K2 


7 / 2 ( 7 ? — 1)4 


' n(v - 1)3 


1920(« - 2) _384 _ 

^ n(n - 1)4 ^ („ - 1)4 


. (11.34) 
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lt(2*) -= —-Kit - 

~ n*{n ~ 1 ) 


n\n - 1)« 

00 

^ 160(}i -- 2)(31« - 53) 


160(» — 2) 240{2?i» — 5n -f 4) 

—t;---- A/ -— 

nHn — IP n*{7i — Ir 

n^{n — 1 )® 




7i*(n — 1)2 ‘ n^(7i — 1)2 

96(n -~-2)(7n2 —14n + 9) 4(113lP~520nM-950?^2~-800/^-f-265) g 

n ^('Ti — 1 W ^ ^ <nA('n — 1 \5 ^ 


, 1200 . 4800(?^ - 2) . 2400(57^2 „ i2n +9) 

+ o7- ~ t -^ ^ K^K^Ki 

7i\n — 1)2 *' n\n - 1 )® 


n^{7i — ])* 


v^{rt — 1 )* 
960(«-2)(6n*-]2n-f 7) 

‘ ^ iF' ^ 


1920(m - 2)(9w2 — 23» + 16) , 480(11 m» - + 59//, — 31) ., 

~ f)» XiX^K;, -t- ^ ^ K-^ 


9600 


38400(/t - 2) ^ ^ ^2 L 6600(4w2 _ 9 ,( .j 6 ) 




n\n - l)s 

28800(2w2 — In + 6 ) ^ . 660(» - 2)(5w - 12) ^ 28800 

^ 7?2(^~1_ 2^6 “ ^4^3'^2 ~r ~ ^2/« "F\y ~ 


n\n - 1 )® 




, 38400(w — 2) 
//(// 1)5 


xWi + 


3840 

— 

{n 1 )® ^ 


. (11.35) 


Th ird k-Sta f istir 


k(:p') 


1 

^6 t 
// /I 


K^K2 1 


7^-1 


67/ 

{n — IX/// 


k-® 


. (11.36) 


1 ^ 27 ^ 27(37/ 4) ^ 27(4// - 7) 

n(7 - 1 )'^’"“ n(n 7 i). . f)!/ 


54(4h - 7) 162(5// - 12) 36(7//^ - 30// | 34) , 

(// — \y\n — 2”)'^°'^^ {n - l)2(?t - 2)'""'"’'^' (« - l)^>i 2y^~ 


^ 108/K5« - 12 ) 

(// l) 2 (w - 2)2 ®- 


. (11.37) 


//3 //2(// - 1) ^ n%71 - 1)2 " " ^ «2(// - 1)3 * ‘ 


, 108(7//3 20// -t- 16) , 27(17//3 - 47?) H 39) , , 27(37// 70) „ 

4 — K-jK ,1 - — ACft f - KaKT, 

n^n - 1)5 r/3(// - 1 )» ® //(// - 1)3(// - 2 ) * “ 

324(19«,3 67// 4 .54) , 162(65//» - 245// -j- 234) 

/ 1 X 1 / ’ XiK^K^ + . is.T- o^ XtK^K^ 

n(7i ~ l)5(/t — 2 ) '//(// — 1 )^(// 2 ) 

108(82//3 - 481//3 4- 958// — 640) ^ 108(59//3- 220// -4 224) ^ 

n(n — iFw -- 2)3 “ ^ «(// — 1 ) 3 (//, — 2 ) 

, 324(75//5 - 473//3 4 - 1016// - 756) 

'' v{n — 1)3(// -- 2)3 1/4 5 

27(173//,^ — 1503//® 4- 4962/i3 _ 7380// f- 4200) 3 
n{7i — 1^®(// — 2)* '* 


+ 


108(71//3 263// -f 234) 

(// 1 )®(// - 2)3 


/f,/C.] -|- 


648(79//.3 - 343// + 378) 
(n - lF(« - 2)3 


Ks,KiK^ 


486(63//3 - 290w + 352) ^ 2 972(99//.® - 688 //® 1 - 1612/1 - 1280) ^ 

'(//,- 1)®(«, 7 2)3 -I- - (/I l)3“(/i - 2)® 


/Cj/fJ/fa 
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162(87»» - 694»» + 1420» — 1176) , 972(23» 

-"T-- 


+ 


"(« - mn - 2) 

648w(103«» - 610 m. + 640) ^ , 648m2(6m — 12) , 

(w - 1 )®(m - 2)* ^ fh - mM -'2^'* 




(n — l)®{n — 2)^ 




(1L38) 


Fourth k-Statistic 

k(4«) 


-- Kg 4 - ~ #C«#C2 f — _ + 

n n ~ I n — 1 n 


34 


-/<r| f 


72m 


— l)(n ~ (m 1)(m - 2)(m 3) 


r " ‘ (n ~~ l)(n - 2) 

24m(m + 1) 


K^kI 


k{4^) 


,K12 4 


48 

n(n — 1 ) 


Kioxr* 4~ 


1G(13m - 17) 


n(n ~ 1)2 


ro~ 4- 


12(41m - 65) 


, 29) ^ 12(37m - 70) , 

r?(n - 1)2 y?(;? 1)2 


f- 


48(16m 

v(n - 

288(19m - 41) 


7t{n — 1)2 

72(1 iM 19) 




1)> - 2) 




{n ~ 1)2(« 


, 48(203« - 523) 

2) + („ _ !).(,, _ 2)"*"^"^ 


(11.39) 


144(.56r( ^ - 2.57 m t- 302) ^ , 1440(4« -11) ^ 

~ {n - 1 )*(m -2)2 (w 1)2(« - 2)'^'^'^* 

1152(22w2 - 106 m f 133) 8(709 m* - 3430m f 4466) 

^ (w 1)*(M — 2)* _ 2)2 

288(19«» 98m* + 126m -j^2) , 1728(24 m® - 140w* -f 200 m +- 4) ^ 

“(M - l)'^(»r-^*^^3r" (M - 1)*(M 2 )*(m 3) 

432(49«*-287M*-|-408M-fl2) ^ ^ ^ 864(103 m»- 629»* + 948w | 24) 


(m 1)*(w -2)*(m-3) 


+- 


_j_ 


288(4Im«-384mM 1209w*-1282m-36) 288m(53m*-179m-.52) ^ 


(m—1)*(m 2)*(m 3) 

^ 288m( 

~ + / — ,T,; ~ '<*K 


(« 1)*(m -2)*(m-3)* ■ •* ' (m-1)*(w-2)*(«-3) 

1728«(29At*-196M* + 317M-) 62) ^3 1728 m(m-|-1)(m* 5m , 2)^, 

KoKo V ^ 


(m ~1)2(m-2)2(w--3)2 


(n ~l)2(w -2)2 (a?^3)2 


(11.40) 


k-Statistic 


«:(5®) == -KTio -f- ~ 

M 


25 


100 . 200 

/Ch /<2 - K 7 KS 4- - KiKi 4- -- 

1 M~1 M — 1 n 


125 


1 




200?i , . 1200 m , 850m 

(m — 1)(m — 2) (m — 1)(m — 2) (m — 1)(m 


+ 


1500m 


(m -- 1)(m - 2) 

1800m(m 4- 1) 


+ 


600m(m 4- 1) 


(^ - l)(r? -- 2 )(m - 3) 


k^kI 


f - 


1)(M 2)(m 3) 


kIkI 4 


120m2(m 4 5) 


2 ) 


kIk^ 


(m — 1)(m — 2)(m — 3)(m — 4) 


. (11.41) 
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k-StaHsHc 

ic(6*) = —/Cjj H-^—(36 KiaXt + ISO/fg/fj + 465/C8»f4 + 780 k:, icj + 461 k^) 


+ 


n 


(450KgK| + 3600 k7K,K2 + 7200k*k4K* + 6300ksk| 

OkIk, + 21600k5k,k, + 4960k3) 

(2400k,k| + 21600ksK2k| + 15300k|k| 


(n — l)(w — 2) 

+ 4500KfK, + 21600 k5k,k, + 4960k3) 

n(u 4- 1) 

{n - l){n - 2){n - 3) 

+ 64000k4k5k2 + SIOOkJ) 

+ (» - 1)(» -’i(t - 3K. - + ^‘*“'‘5’^' 

±i)(5'‘ + ^5 ^ - * ) 72o«.« 

(ri - l)(w - 2 )(n - 3)(« - 4 )(n - 5) ' 


(11.42) 


Pnxluci-Cumulant Formulae 
/c(32) 


1 

- /<6 4 - - 

)\ n — I 


/c(42) — - /Cfi f ^ k^K2 I ~ .*<1 
ti ?? — J ti — I 


6 

20 


/ro^ I , 

k(C) 2) — -Kf i- K^K2 ^ K^K:i 

n n — I V - I 


k( 62) =- - Kg 

11 


VI , 30 , 20 . 

W - 1 W —- J — 1 


k(72) = - K^Ki -r - K 0 /C 3 + AC 5 /C 4 

H V ~ I n — 1 t? - 1 


KiSZ ) === /Cjo t , f--, «’7«’3 4- -1- 

H 9?-l n — \ 71-1 


/^ox - . 12 , 30 , 36w 

K(4tZ) = ~~Kt + - -rACfifC* 4 - - K 4 /C 3 4 - - --p-• 


1 


1 


(11.43) 

(11.44) 

(11.45) 

(11.46) 

(11.47) 

(11.48) 

(11.49) 


{n - l)(w - 2) 

/c(53) = - /cg H-^ (IS/cgKg 4 45 /< 6/<'3 4- 30/<'f) 4 --^ (60/c4/c| 4- 90;c|f<r*) . (11.50) 

n n — 1 (n - I)(w — 2) 

k(63) 

n n — i 

(OOkjkI + 360k«k,k* + 90k*).(11.51) 


- 4--^~(18/C7/Ca 4- 63/C6K3 4~ 105 k-6#C4) 

n n — I 


4- 


n 


{n - l){n -- 2) 


#c(73) = ~ Kio 4~ ~ ^ (^I'^s^a 4*- 84 /C 7 /C 3 4“ 168K’e/c4 4- 105 k-J) 

71 n — I 


+ 


n 


{n — l)(w — 2) 


(126^e/c| 4- 630#C5#C3/C2 4“ 420/cf/<2 + 630/C4/c|) 


. (11.52) 
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fc(54) == i/cj + (20/c7/Ci -f VO/cgiCa -f 120#C6/C4) 

71 w — 1 


+ 

+ 


n 


(n — 1)(7? — 2) 

+ 1 ) 

(n — l)(w — 2)(7? -- 3) 


(120ic 6^2 ^OO/c^/Cg/Ca *-)- I8O/C3) 

240/1:3/^2 


k( 64) i Kio H-^ _ (24/f„/C2 }- 96 /C 7 /C 3 + 194/<*e/C4 + 120/c|) 

n n — 1 


+ 

+ 


n 


(180/c«/^| + lOHO/Cs/Ca/v'a f- 120k\k2 + 1260/<r4/c^) 


(n — l)(n - 2) 


ic(322); 

#c(422) 

K(r>22) 

#f(622) 


1C) 


71 






«(/2 - 1) 
20 


71 - 

+ 

1 


//(// - 1 ) 

2 


/<'6/<‘2 


12(271 - 3) 
n(n 1)2 
8(57i - 7) 
n{n — 1)2 


48 


/<^5/<3 


- 1)^ 
4(7/? - 10) . 

r/(/r - 1)2 


80 120 


, 24 20(3// - 4) . 20(5/^ - 7) 

7 /( 7 ? 1) 7/(//. - ])*• 7 /( 7 / — 1)2 


120 

(v -- 1)2 


480 

(rr~ 1)2 


120 




(// - 1)2 


28 


, 12(7// - 9) 4(4J7/ - r>f)) 

7/“ r^(n 1) 7/(r/ — 1)2 //(// 1)-^ 


168 


840 


. 20(5^/ 7) , ... 

7/(// - 1)“ (// I)- (// - 1)2 

, 840 

^,7-1)^"'"-*. 


r)6<) 

(« - i)= 


k(3^2) 


<r(432) 


1 , 21 6(8w - 11) , 9(3w 

., «’8 ) , ,/<:ef<2 -i -,> 

n{v — 1) w(m — 1)® n(v — 1) 


);f2 

2 '^* 


18(6w - 11) „ , 18(9« - 20) „ , 


3()« 


{n - 1 )■•“(« - 2) 

1 2 « 


(n - 1)*(m - 2) 


{n - !)'=(« - 2) 


, Xi> 


7l{tl — 1) 

30(r)7( - 9) 


24(3m — 4) , 10(1 Iw - 17) 

x^Ki -t -T,, «’e'fa i- 


n(n — !)■* 


7){r) — 1)^ 


o. x-ix'i + 


12{61»t — 128) 


(ri - Lyi{n - 2) ’ ^ l)^n 2) 

, 3607/ . 




36(5// ~ 12) 

„ 2)^ 


k(532) 


, f 


31 

71 (n - 1) 


, 10l7i - 131 , 5(S7r/ - 55) 

/<78/Ca + /C7/<3 f ^ 


n(n — 1)2 

5(23n - 35) 30(9« _ 16) 30(45^ - 92) 

n(n - 1)* “ ^ (ra - l)*(w - 2) ® * ^ (w - l)^(n - 2) ' * 


n(n — 1)^ 


. (11.63) 

. (11.54) 
. (11.55) 

. (11.56) 

. (11.57) 

. (11..58) 

(11..59) 

. (11.60) 




PRODUCT-CUMULANT FORMULAE OF ifc-STATlSTICS 


273 


k(4*2) = 


/c(43») =- 


«-(32'’) 


k(42'') 




9 9 


60 ( 15 « - 31 ) . 30 (_ 46 » - ^ + 

4 

— I 

1 , 32 

* ” 1 ) ti{n — 1)2 7 

1536 


72ihi ^ 

~ 2) " (n - !)*(/» - 2)"•"* (« ] )^(» - 2) 

1620W 

{n — l)*(w ~ 2) 


. (11.61) 


, 8(1 3m - 37) , 4(49m ~ 73) 

"‘»^«(« - I)"""' ^ >,{n - 1)*= ^ M(M - 1)^ 


4(29« - 46) 

^ m(« - 1)== “ 


H(37w - 65) 

(« 1)2(« - 2) 


x«xl t- 


(« - 1) 


KsK-jK-j 


144(7m - 15) , , 72(21« - 50) ^ 96(10»-* - 27m - 1_)_^ 

)■ /.r- no/.. oi '' 1)^(m 2) (m — 1)®(« — 2)(m — 3) * ~ 


{n - 1)*(m - 2) 

144(17«2 —53« 2) 192(m)(/( + 1) 

(M - iy{n - 2)()i 3)'^-*'^- ^ (« - 1)=‘(m - 2)(m 3) ' 

1 33 6(]9m 25) 3(65« - 107) 

m(/i — !)■* m(w - 1)^ 


(11.62) 


M® ' «(« — I) 

I)® 

54(1‘)« 48) 


6(1922 - 34) 18(1922 33)^^^,^ 72(23« 52) ^^^^^^ 

22 (m I)^ ' ^ (22 - 1)^(22 2) ' (22 - 1 )^(m 2 ) 


54(3372-' 14822 +■ 172) „ , 

^ (22 - 1)=“(M - 2)^ 


(« !)==(« 2) 

7222(1722 - 40) , 10822(27/2 - 70) . 

(72 - 1)^(72 - 2)^'"''''- ' (M - l)'-=(22 - 2y ' 


21622== 


(m - 1)=(27 — 2y 


2 C .2 . (11.63) 


1 30 , 2(3122 - 53) J 12(972= -23/2 -r 16) 

22 ^'^" ^ 22 =(22 1)'^’"“ ^ 22 =(22 1)= '■ 72 =(22 -1)3 

240 , 360(222 3) 24(.522 - 12) 480 

f 22 ( 22 1 )="^"^ ' 72 (22 1 )3 22 (72 - 1 )= ' ' (22 1)="“"^ 


1 


'M) 


, ^10 


72 -(n- 1) 


4(2322 37) 4(4 

* „ ,v. «'-'<■ 1 


12(>22 j 81) 


22 =(72 1 ) = 


12(9/2= - 24/2 1 17) ^ 300 

22 =(22 - 1 )= ' 22 (22 - 1 ) = 
144(7/2 10) , , 24(49/2 95) 

' 22 (22 l )» " 22 (22 1 )" 

37 0(1722 - 27) 


KaK'^ 


2SS(,5y/ - 7) 
h(n ])^ 
960 




2160 


(/y 1)^ 


(22 - 1 ) 


,«<!«i (11.65) 


1 


^10 1 

H ‘ 


2(59/y2 


// • 


24(7 l/y^ 

- 

71 (7i 


36(38/^2 

- 

ri{7i 



'll,''/ 


K-K, ^ 


3(61/2= 160/2 I 117) 


22 2(22 1)= ■ 22 =(22 1 )=* 
1<>422 113) , , 0(6722 131) 

!)■’ 22 ( 22 1)=(" '-i) 

246/2 ^ 202) , 36(29m= 103// =- 93) ., 

1)3(„ 2) M(22 I )=(22 2) 

15072 + 160) 72(14/2 23) 

1)=(22 2) ‘ ‘ ' (72 - 1)“(72 - 2) ’ “ 

288/y 


KqK^ 


144(19/7 - 44) , ^ ^ 

(72 1)=(7' - 2) ^ - (M - 1)=>(M - 2) 


(11 66 ) 
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11.16. Additional formulae for the case of a normal parent population have been 
worked out by Wishart (1930). There are two general formulae:— 

2'-i(r - 1)! ^ 

(n - iy-^• 

2'(r + - 1)! 


;c(20 

/c(p^2') 


. (11.67) 


(|pg - 1)! (» - ■ ■ ■ • (11-68) . 

and the following specific formulae of degree 12 and upwards (those of degree 10 and lower, 
of course, being derivable from equations (11.30) to (11.66) by putting all k’b higher than 
the second equal to zero). 

34,560« , 


k(3*2«) = 


k(3*2) 


(n - iy'(n - 2) 
12 ) 


7776fi.^(rm 


(n - l)‘(n -- 2)» * 


^(342.) ^ 10H.8(54/.=(5a -- 12) 

’ (a - l)S(a - 2)3 ^ 


k(3<23) 


l,741,824a2(,5„ - 12) „ 
(» - !)«(« - 2)3 


_ 466,.')60n3(22«3 - lllw + 142) ^ 


«:(3«2) 


18 /..a, 

- a,/c(3”) 

n — I 




sr(4*23) 

k-(4323) 

s:(4*2*) 


1020a(?/ + 1) „ 

(H~ 

23,040a (a + 1) , 


(n - l)*(n - 2)(« - 3) ^ 
322,560 m(« 4- 1) „ 

(a - 1 )'>(ar-~2)(M - 3) 


af4321 = 20,736a(a + l)(n3 - 5« + 2) 

' (n - l)»(w - 2 )*(m - 3)* * 

290,304w(a + l)(a* - dn + 2) . 
- („-3). "S 


k(432») 
a(4‘) 
k(4«2) 
k( 4*2^) 
a(46) ^ 


4,644,864a(n + !)(«■“ — ■'in f 2) 
~(n -“l)«(tr-^2)3(a -- 3)3 
6912i^a -r 1) 

(n ~'l)3(« 2)^(n - 3) 

16 

n -1 
288 

(n“l)3 

484.12‘> ,0 ... 

-jl — Kj” approximately . 


Kaa(4‘) . 

.K|a(4«) . 


.(11.69) 

.(11.70) 

.(J1.71) 

.(11.72) 

.(11.73) 

.(11-74) 

.(11-76) 

. ( 11 ." 6 ) 

. (11.77) 

.(11.78) 

.(11.79) 

.(11.80) 

.( 11 - 81 ) 

{53a‘ - 428w» + 1026w3 _ 474 ^ ^ 180}a*. (11.82) 

.(11.83) 

.(11.84) 

.(11.85) 
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In virtue of the result of Example 11,4, expressions of odd degree vanish, e,g. 
k(’32*’) =5 k(62»’) =; 0. Further, in virtue of (11.68), K{p2^) o if p > 2, for k{p) =x: = 0 

for the normal distribution. Methods of proof of (11.67) and (11.68) are suggested in 
Exercise 11.9. Exact results for /<:(4®) and fc(4®) are given by Hsu and I^awley (1939). 


Proof of the Validity of the Buies 

11,17. We now proceed to prove the validity of the rules enunciated and exemplified 
above. Rules 1 and 2 have already been proved. 

As a preliminary let us define an operator such that 

dp/i'r r(r - 1) . . . {r - p + l)Pr-p »• > jpl 


SpMr =0 r <p 

and d^(AB) = {dj,A)B + A(dpB) . 

80 that d acting on a product is distributive. 
In virtue of (11.87) we have 


( 11 . 86 ) 

(11.87) 


dp, 


7 {P'r)”' ^pPr- 


It follows that if / is a polynomial function in the /^’s 

V 




( 11 . 88 ) 


and this also holds if / can be expanded ip a series of polynomials in the /(’s. 

Now consider the expression defining the seminvariants in terms of the moments (3.11) : 


exp ^it (' 


+ Sn 4 

^p\ 


...) 


i pd + . . , 


p\ 


“1 


On operating on both sides by there results 
exp ^>Ci^ + . . . ^ ’ ‘ 




and hence 


i 


1 1 p\i 


P p 7 
tv 


= tp + 7 


d„Kj - . . . . . = t“. 

This is an identity in 1 and hem‘e 

dj,Kp p\ 

dgKj, -= 0 

For example, 

^^4 =- 4^^', - 3/y I ]2/4/y -6//'/ 

diKi = 4/43 - — 12/42/*! — 12/4'„/<j + + 24/42//', — 24/4',^ 

= 0 

dttCt = 12/42 — 24/47 — 12 / 4 '2 + 24 / 4 ^ 

= 0 

^8**4 ~ 24/4, 24/4, 

= 0 
dtXt = 4! 


q 7 p] 


(11.89) 
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11.18. Now in accordance with Rule 1, which we have already established, 
and hence may be expressed in terms of parent/c's by an equation of the 

form 

. . .) =-. . .)} . . . (1L90) 

where A is a factor which it is our object to find. Operate on both sides of (11.90) by 
3,,/“ . . .). Every term on the right is annihilated except that in Ki,f^ . . .) 
and we have 


... - . . . ) . (11.91) 

We now consider an o})erator analogous to 3^, which, when acting on a power of x (of 
any suffix), reduces the (exponent by p and multiplies by r(r — 1) . . . (r — p -f 1); and 
we will suppose the operator to be distributive.* Regarding /i(n/‘ . . .) as the mean 

value of . . .) we sec that the result of operating by the 3’s on the mean value is 

the same as that given by taking the mean value of the operation of the 3’s. But this 
latter operation results in a constant, which is equal to its mean value ; and we thus have 

. . .) .. 

. . tiJ fiJ '' "• 


A 


k., 


(h.ir^... til', pi-. 

Our rules are concerned with the evaluation of this operation. 




(11.92) 


11.19. Cbnsider now a completed array of type (11.28). A little retleotion will show 
that there is one such array for every term in (11.92) which does not vanish by operation, 
and that every term in (11.92) will have its corresponding coniy)let('d array. The numbers 
in the body of the amiy are the powers of x occurring in the /^-product ; added horizontally 
they compose the orders of the operators ; added vertically they com])ose the' orders of 
the corresponding A’s. A completed array is, so to spc'ak, a chart of pari of llu' operation : 
and the whole oj)eration is the sum of all j) 08 sible (‘omj)leled arrays. 

The operation (11.92) gives us the coefficients in //(u/’ . . .), but we wish to find 

those in the corresponding /c(^/i‘*' . . .). The necessary allowamje is made by Rule 3, 

which we now })rove ; that is, the coefficient of (/c/^/^‘ /o/’" . . .) in . . .) is given by 

all completed arrays, ignoring those which are resolvable into separate blocks each connived 
to separate rows and columns. 

Referring to equation (11.27), expressing the relation between multivariate moments 
and cumulants, w^e see that /<(ai'*' ag®' . . .) is the sum of terms com}) 08 ed of products of 
one, two, three . . . multivariate moments. The first term is f'a*" • • •) itself. 

Consider a two-part term such as * 02 ^' * • ' • • •). where a, { oCy oci, 

etc. Its coefficient in the expansion on the right-hand side of (11.27) is 

_ 1 ^ 

^ 1! 1! ai! aj! a.^! cQ. ' ' ' 

and hence the coefficient with which it appears in the formula for r/j®* . . .) is 


ap a, ! ag! ! V'^i/ 


. (11.93) 


Now//(^/i®‘U 2 ®" . . .) will itself have an array of type (11.28) with column totals (r/j“'^ . . . 

and row totals, say (b/'^ b/^ . • .) ; and similarly for' • • •)* Provided that 


* nmj’ be regarded aw equivalent to 



dP 


dP \ 


i.e. to ASf^, in the 


notation 


of 11.10. 
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^2 + == Pi these arrays will correspond to terms in the k's which, when multiplied, will 

give a term in « .), Thus the product of these terms may be considered as an 

array of type (11.28) with column totals Ug** • * •) and row totals (6/^ . . .) and 

with the body of the table resolvable into two separate blocks. Since there are columns 

of total «!, there will be products of this typo in the expression which gives 

a*®* . . .). This factor is the same as (11.93) but of opposite sign. Hence, if wo 
ignore the separate two-part blocks in the array for ju we shall have allowed for the products 
of two moments which must be subtracted from ju to give k. 

Now some of these separate blocks will themselves be separable into two blocks, and 
in subtracting them all from OTg®* . . .) we subtract too much. For example, if there 

are three separate blocks, L, M, N, we shall, by considering L and (M + N) as two blocks, 
have subtracted L, M, N. We shall have done the same by considering M and (L + N), 
and N and (L + M) as two blocks. That is, we have subtracted 2L, 2M, 2N too much. 
We must restore these blocks to the arra^^ for ^ again. Such additions, summed over all 
blocks of three, will be found to equal the terms in the expansion of (11.27) which result 
from the product of three moments. 

In restoring these blocks we restore too many of the cases v^here there are four separate 
blocks. These must be subtracted again, and correspond to the negative t(^rm in (11.27) 
involving tlie product of four moments. Proceeding in this way we establish Rule 3. 

11.20, Now we proceed to Rules 4, 5 and 0, which are the fimdamontfal rules of the 
whole process. Consider again the array of type (11.28) to fix the ideas, say, 


2 3 

1 1 
1 . 


1 


. 1 

4 2 


I 10 


. (11.94) 


This airay will represent a ruirnbej* of terms in the operation, eacli of which consists of the 
operation of 0^ on a term (tlae first row), O 2 on .v.a’ (the second row), and so on. 

Provided that the siiflixes of the .r's in aii 3 ^ row are alike, every suffix of the .r’s will provide 
a term, for contains terms with every distribution of powers (adding to p) and suffixes. 
There Avill, for instance, be terms of the following kind ;— 


.r., .r., 


^ 3 , 


.r, 

X., 


■n 

X, 


In fact, for any completed arra 3 ^ W’^e have terms in which 

(i) all the x^s have the same suffix (7l in number, one for each suffix), 

(ii) all the ,r\s but one row have the same suffix (//(?/ - 1) in number), 

(iii) all the but two rows have the same suffix and the remaining two are the same 

(?^(a 1) in number), 

and so on. These cases correspond to the various separations dealt with in Rule 5. 

Now in case (i) the term in any column arises from the term in x^^ in kj, and (apart 
from numerical factors which are considered prescntl 3 ") is n ^ from equation (11.10). 
Hence an 3 ^ column which contains an entry contributes a factor 7t ^ and the total function 
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of n arising from case (i) is the product of n and of to the power of the number of 
columns containing a non-zero entry. 

Similarly in cases (ii) and (iii) the n-function for each separation is the product of 
7i{n — 1) and, for each column, a factor in or according as the column contains 

non-zero entries in one or in both parts of the separation ; and so on. 

Tliis explains the origin of the pattern function as described in Rule 6. But in order 
to establish that mle completely (and incidentally to establish Rules 4 and 5) we have to 
show that the numerical coefficients arising from each separation are the same. When 
tliis is done the validity of Rule 6 is demonstrated, for the separate contributions in n may 
be added together to give the pattern function and the whole multiplied by the numerical 
co€^fficient. 

$1 may be considered as the operation of picking out an x from the operand in all 


possible ways and replacing it by unity. 


Similarly ^ 


may be regarded as picking out 


p x's with the same suffix and replacing them by unity. It is thus evident that operating 


on a k product by a 0 product 


6x! b,\ 


of the same degree will yield a result which is 


the number of ways in which sets of :r’s can be picked out of the k product so that each 


set contains bi of one suffix, b^ of a second suffix (which may be the same as the first), and 


so on. 

Now consider the operation (11.92) in which the k's are expressed in the simplified 
form (11.17). The operations 0 being distributive, we shall emerge from the operation 
with a sum of terms comprising all the possible ways in which the individual .r's can be 
picked out of the k product such that the low and column totals of the two-way array are 
satisfied. Consider the sets corresponding to a particular array, such as (11.94). The 
contribution to the total will consist of the ways of picking out individuals such that 

(i) from the individuals in the first k^ are chosen four in the partition (2, 1, 1), 

(ii) from the second l\ are chosen four in the partition (3, 1). 

(iii) from the ki are chosen two in the partition (1, 1), 

(iv) these are associated in all possible ways such that individuals in a row arise from 

the same suffix. 

On consideration it will be seen that the total number of ways of doing this is the number 
of ways of allocating the individuals from column totals as required by Rule 5 ; cuid this is 
true whether sets of rov)s hare the same svffix or not. 

Rules T) and (>, and hence Rule 4, follow at once. 


11 . 21 . 'I'he remaining lules are ancillary. 

Rule 7 follows from Rule 2. In fact, the pattern function is indojiondent of the numbers 
composing the array, and the pattern with a row containing one element can therefore 
form the skeleton of an array in which that element is unity ; and this would entail the 
appearance of k,, which by Rule 2 is impossible. 

Rule 8 follows from Rule 6. The column containing the single element appears in just 
one separate of all the separations, and the contributions to tlie pattern function are thus 
all multiplied by owing to its presence. 

Rule 10 follows from Rule 8. The addition of a unit part is equivalent to the addition 

of an extra column containing unity. This multiplies all pattern functions by leaves 
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numerical coefficients unchanged and increases the suffix of every k according to the row 
in which the unit appears. 


11 . 22 « There only remains to prove Rule 9. Note that any pattern function can be 
evaluated linearly in terms of the functions of the pattern obtained by omitting one of 
the columns. For example, consider the right-hand column of 


. 

X 

X 

X 

X 

, 

X 

X 

X 

X 

. 

. 

X 

X 

, 

. 


(11.95) 


and the contributions to the pattern function from it. The 15 separations which are 
possible with four rows can be divided into two classes, that in which the two rows 
in the fourth column lie in the same separate and that in which they do not. In separations 
of the first type the contributions from the first three columns will be the contributions 
of all separations of 

XXX 

XX.(11.90) 

X X 


in which the first two rows are amalgamated. (^IJonsidering the function of the first three rows 


X 

X 

< X 
X X 

in which amalgamation has not taken place, 
contributions which do not occur in the first, 
that the contribution is 


X 

^.(11.97) 

we see tliat the contribution consists of all 
Calling the first A and the second B, we see 


Ia - ^ L (B-A) 
n nyv -- 1) 



A 



i.e. a linear function of the derived patterns A and B. The proof of the general result 
follows exactly the same lines. 

Now if a pattern may be divided into two groups connected only by a single column 
we can reduce it step by step by omitting the other columns. We end up with this single 
column, and the f)attern function of this column must vanish ; for the column total 
a coiTesponds to whose mean value the one-column array expresses, and since by definition 
this mean value is no composite terms such as would be given by two rows or more 
can appear. 


11.23. As an illustration of the way in which the sampling formulae can be used to 
approximate to a sampling distribution, let us consider the distribution of hi samples 
from a normal population. We have, in terms of tlie sample moments, 

n — 2 

^ ma \/n(n — 1) k^^ 

For a normal distribution the variance of k^y ^(3^) is, by (11.3(>), equal to 



280 


APPROXIMATIONS TO SAMPLING DISTRIBUTIONS 


We therefore consider the statistic 


* - /" 


(ft - l)(ft - 2) , , 

..—. „ _ ---- 




_ « — 1 

" v(^-2)y'" 

which will, to order have unit variance. We have 

- l)(n - 2) 


/{» ~ i)( ^^ -j- 

\/ 6« K2''\ Kj J 


. (11.98) 
. (11.99) 

. ( 11 . 100 ) 


8ince the population is symmetrical the mean value of x is zero. We then have, expanding 

( 11 . 100 ), 


^2 _ (« !)(’' - 2). J Jx.2 _ 3 - ^ 2 ) + ^ kl{k, - - '^ 2 )^ 

\in ^2 L ^2 ^2 ^2 


+ - «,)* ‘^\ki(k, K,y> -i ‘^~ki(k, - K,r 

K* K'i #C^ 


. (ILlOl) 


The variance may be obtained by taking mean values of both sides, and since is the 
mean value of A :2 w© have 


var (.r) 


(n — l)(n — 2) 1 


i^ri 


3 


6 


10 




. ( 11 . 102 ) 


1 r: i.>i 90 

-F ;M3^2^) - //(322«) f /.(322«) I . . 

Kl kI kI 

We now express the product /i’s in terms of product /c’s by using equation (11.27) 
and identifying coefficients. For a normal distribution k( 32^) -= 0 and we will take oiu* 
approximation to order 7t~^, so that k^& of five parts or more may be neglected. We 
then find. 


var X ^ 


(n - 1)(7/ -- 2) i 


On 




:r') 


+ ~{/c(;r^22) + k(3X22)} 


- ^®{«-(3'^2») I- 3»<:(322)(c(22) + k( 3‘')«:(2»)} t ^(Gk(3222)k( 22) + 4K(322)Kr(23) 
^2 ^2 

+ /c( 32)/«:(2‘) . 3K(32)«r2(22)} - "^li>K(322)/c2(2==) -4 10/<r(3’'')K(23)/f(22)} 

^ ^^^.]5^(3>='(2=‘)1. 

J 


(11.103) 


Substituting the values of equations (1J.3J) to (11.85) we find, after some purely algebraic 
reduction, 

28 120 


var .T 


1 ^ (7t - 1)^ (71 - 1)3 


71 


6 22 __ 70 

n 7i^ 


In a similar way (for details, see E. S. Pearson, 1930) we find 


fA,t(x) ~ 3 


1056 ^ 24,132 


71^ n ' 

is zero, for the distribution is symmetrical. 


. (11.104) 

. (11.105) 
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Thus it appears that as n oo the second moment of x tends to unity and the fourth 
moment to 3, which is in conformity with tendency to normality. But the tendency is 
by no means very rapid. When n — 100 the variance is approximately 0-942 and in 
assuming x to be distributed with unit variance we should commit an error of about 
6 per cent, ^ 

11.24. There are two ways of improving on the first approximation that x is normally 
distributed with unit variance. In the first place we may consider a transformation to 
a new variate chosen so that f is normally distributed to order Secondly, 

we may fit a Pearson curve to the distribution of x, using the values of moments given 
by (11.104) and (11.105). The appropriate curve is the Type VII 

f/F cx:f 1 dx .(11.106) 

The first line was adopted by Fisher (1928), who obtained the following transformation; 

The second was adopted by E. 8. Pearson (1930), who tabulated the I per cent, and 5 per 
cent, significance points of (11.100), that is to say the values of the deviates x for various 
values of n such that 90 per cent, and 95 per cent, of the total frequency of the sampling 
distribution falls within a range of ± o' on each side of the mean. 


The Multivariate Cam 

11.25. The foregoing results can be generalised to the multivariate case, and we 
give an outline of the extension to that of two variates. 

(liven any bipartite number we shall have for any partition • • •} 

and the bivariate cumulant a /.'-statistic whose mean value is Explicitly 


- 2)\ p'l r 


(- ly-Hp - 1)! 


1 IpI 


V •<•/'//2 ^'’’ • • • yf‘) 

“ (Pj!)”' (pi!)"' • • ■ TTi! TTj! . . . 


(11.108) 


In particular, corresponding to (11.22) we have 


^11 


‘‘’’lo '^(h) 


*21 


2wtfi„ .s,, 

ns.„ .s„, + 2s‘f„ *■„! 


*31 + 1>^31 ~ 4 i )‘^30 '‘^01 - - 1)^11 ^20 


K11.109) 


S'n{ 7 i ^ 1)2^21 .Sxo 4 -I - h.s'o, si 


71 


(n — l)(7t — 2){7t - 


3) [ V H n 


2(n ^ 1) 8 ,2 V , 2 

«io -'^2 ‘^'lo 4- - •'^20 
n n n v 


,2 <>2 \ 

01 2 I 
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In generalisation of tJie mean value functions of the k’s we may write, for example, 

kKho *u) - /‘(y J) 

mk.o ku h,) 

with corresponding at’s. The latter may be expressed in terms of the ciimulants of the 
bivariate distribution as in the univariate ; and the coefficients will now depend on partitions 
of bipartite numbers. Our rules still apply (and in particular the pattern functions 
appropriate to particular arrays are the same) ; but the numerical coefficients associated 
with completed arrays are modified, for wc now have to consider the number of ways of 
allocating two different sorts of individuals in a two-way partition of a bipartite number. 
An example will make the modification clear. 

/2 2 1 \ 

Suppose we wish to find the coefficient of K’n/cji in 1. The total degree is 

10 and, the orders of the product being 6, 2, 2, we have to consider arrays of type 

6 

2 

2 

4 4 2 10 

i.e. those we discussed above. The pattern functions are those we have already found. 
For the numerical coefficients we have to regard the column totals as consisting of the two 
types of object in number (2, 2), (2, 2), and (1,1) and the row totals (3, 3), (1, 1) and 1, 1). 
For instance, the array 


2 

1 

1 


6 

2 

2 


might be written either as 


or as 



4 4 

2 1 10 


(1,1) 

(1, 1) 

(1, 1) 

(3, 3) 

(0, 1) 

(1, 0) 

. 

(1, 1) 

(1,0) 

(0, 1) 

* 

(1, 1) 

(2, 2) 

(2, 2) 

(1, 1) 

(5, 5) 

(2, 0) 

(0, 2) 

(1, 1) 

(3, 3) 

(0, 1) 

(1,0) 

. 

(1, 1) 

(0, ]) 

(1,0) 

• 

i (1, 1) 

(2, 2) 

(2, 2) 

(1, 1) 

1 (5, 6) 


( 11 . 110 ) 


( 11 . 111 ) 


each of which will make a contribution to the numerical coefficient. It will be found that 
no other arrays arc possible excejit those obtained by permuting the first two columns. 
The numerical coefficient in (11.110) and the permui.ed airay together is 






THE MULTIVARIATE CASE 
That in (11.111) and the permuted array is 

2(^?1V 2! ^4. 

V27V’! 17\1-1V\27 2! 

The total contribution is thus 20. The pattern function is ^ 
In the same way it will be found that for the partitions 
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2 3 1 
1 1 . 
1 . 1 

4 4 2 


(i 

2 

2 

10 


3 3 . 
I 1 

1 1 

4 4 2 


G 

2 

2 

10 


I 

l)(H 


the eoefticients are 48 and 8. Thus the desired ooefHcient of is 

20 ^ 48 8 _ 4(19?? 33) 

(n ^ 1) {V - 2) ' (?/ - 1)2 {fi S 1)2 ~ (n iy{H - f 


2)* 


Example IJM 

To find an exact expression for the covariance of the estimates of variance of two 
correlate'll variables, i,e. 

<0 ^)- 

Tilis will (*l(virly consist of thioe terms, in Kj,c,, k.q and For the first we have 

the partition 

(2, 0) (0, 2) (2, 2) 


1 


(2, 0) (0, 2) I (2, 2) 


with ]>attern function - and numerical coefficient unity. For the second no contribution 
exists tlie only arrangement being 

(2, 0) . I (2, 0) 

(0, 2) ' (0, 2) 

I_ 

(2, 0) (0. 2) ' (2, 2) 

which has a vanishing pattern function. For the third term we have 

(1,0) (0,1) I (1.1) 

( 1 , 0 ) ( 0 , 1 )|( 1 ,]) 

(2, 0) (0, 2) I (2, 2) 

1 


the pattern function for whicli is 


(« 


1] 


and numerical coefficient 2. Hence 


/2 0\ J , 2 , 

Y') 2 ) - ,7 


11 . 26 . In conclusion it may be noted that the method of expectations may be used 
to derive sampling moments of the distribution of samples from a finite population. The 
algebra becomes much more complex because the sample values are no longer independent 
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and we cannot, for example, write Tschuprow (1^23) andlsserlis (1931) 

have investigated the subject systematically, the latter giving formulae for the first four 
moments of the mean and the first four of the second moment. Some of these had been 
obtained earlier by Tschuprow himself, Neyman (1925) and Church (1926). We quote the 
following formulae, in which N represents the number in the population :— 


Moments of the Mean : 

E(m\) - 

E{m\ 


- if* 

n){N 


(N-n){N-2n) 

~ n\N - \){N - 2)^'' 


E{m\ - fi[)* 




_N - 
l)iN 


2)(N - 3) 


— tiNn ^ iV + 


-1- 3.V(A" 


1)(« - l)/4} 


( 11 . 112 ) 

(11.113) 

(11.114) 


(11.115) 


i(N7l 


X 




Moinetits of the Sample Variance : 

, (n - l)iV 

■^V * v{N - \)' -) ‘ n-\X - 1)''‘(A' - 2)(A' - 3)' 

— (A^// — t 6.V Ihi — 'f 

Church also gives the third and fourth moments of the sample variance, the formulae taking 
several pages to wiite down. His version of the fourth moment contains errors which 
were corrected by Isserlis. The statistical usefulness of these results seems to be somewhat 
limited, but it would be interesting to inquire how far the combinatorial method appropriate 
to ^’-statistics can be extended to the case of the finite population. 


1)(A 


(11.J16) 


(11.117) 


NOTES AND REFERENCES 

For earlier work on the expectalions of moments see Tschuprow' (1919) and Church 
(1925). Thiele (1903) seems to have been the first to appreciate the ])ossibilities of using 
other symmetric functkms, but owing to the fact that he d(‘fined his sample ^ sc'mi- 
invariants ’’ to be the same function of the observations as the parent seminvariants 
(our cumulants) are of the j)ar('nt values, his formulae lernained complicated. Later in¬ 
vestigations on similar lines were carried out by Craig (1929) and St. Ceorgescu (1932). 

A-statistics were introduced by Fisher in 1928 and subsequently applied to several 
problems by himself (1930) and Wishart (1929a). The theory of the sampling of the statistics 
has been developed by Fisher and Wishart (1930) and applications to th(‘ normal distribu¬ 
tion given by Wishaif (19296 and 1930), E. S. Pearson (1930), and Hsu and Lawley (1939). 
The general theory of the/r-statistics and other seminvariant statistics has been discussed 
by Kendall (1940a, 19406, 1940c, 1942) and Dressel (1940). Dressel has called attention 
to the relationship between semin variant statistics and the seminvariants of the theory 
of binary quantics. The reader who refers to Fisher’s basic paper of 1928 should bew'^are 
of misprints. Methods of deriving bivariate formulae from univariate formulae by symbolic 
processes are given by Kendall (1940r). 



NOTES AND REFERENCES 


285 
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EXERCISES 

11.1. Show that the pattern functions of the following patterns 


X X X X 
X X 
XX.. 


XXX 
X . X 
X X 

are ~ and respectively. 

{n — 1)2 n{n — l)^ ^ 


11.2. Show that the pattern function of the pattern 

XXX... 

XXX... 


(Fisher, 1928.) 


with p-columns is 


1 

f^p~i 


1 


(n ~ 1)^-1 


(Fisher, 1928.) 


11.3. Verify the formulae of equations (11.33) and (11.39). 


11.4. Show that the generating function of the moments of the 


2’ -I Mp"' ■ ■ • P”’)^‘ 

ttJ 


is given by 


* 


j^exp f + liK^ 4- . . .} exp j/ciSi f ‘ ‘ 'jj 

where is the same function of the operators as kj. is of the observations t and - w(.r’‘). 
TIeduce that 

Ap(.v„) -- />' 

~ ** 

where {PiPi . . .) is any partition of p. (FishoT 1928.) 

Note that if M{z) is the moment-generating function of 2 , lliat of 

f =/(*) will be and that of ^ by 

Hence that the generating function of the moments of £ may be Axntlen 

M(C) - 


11.5. Show that 

E{kj,(.Xr 1 A, . .r„)} k^, -l 

and hence that 

SpK -P'- 

=0 q 

0 

where Sp is the same function of the operators as Sp is of the observations .v. 

(Kendall, 1940u.) 
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H . 6 . Show that the generating function of the moments of the Jfc-statistics is given by 

j^exp|^ + . . .^exp{iki<i + + • • •}J 

and hence derive the result of the previous exercise. 

(Kendall, 1941.) 


11.7. Use Exercise 11.5 to show that, in the expression of 1c^ in terms of the sym¬ 
metric sums 5, the sum of the coejRficients is 


n 


Show similarly that if 

Sp == A.pLp -j- 1 "i" • * • H" "^PiPt 


then 


* Pm ^Pl^Pt ‘ ' * 


4 4 4 






(K™dall, 1940a.) 


11.8. Keferring to the result of 11.22, show that for a normal parent population the 

effect of adding a new part 2 to K(ai“' . . , a/*) is to give pattern functions —times 

those of the original. Show also that the effect on the numerical coefficient in an array 
is to multiply by twice the number of rows in the array. Deduce that the effect of adding 
a new part 2 is equivalent to operating by 

2/<r| (I 
ri — I cIk^ 

(Fisher and Wishart, 1930.) 


11.9. Use the previous exercise to establish equations (11.67) and (11.68). 

11.10. In generalisation of Exercise 11.8 show that for a multivariate normal parent 
the effect of adding a covariance (j>, q referring to the j)tYi and gth variates) is equivalent 
to operating by 

where is the covariance of the variates p and q. 

(Fisher and Wishart, 1930.) 


11.11. If a pattern contains a column with three entries ; if the patterns obtained 
by suppressing this column and (1) amalgamating the three rows, (2) amalgamating the 
pairs of throe rows, and (3) leaving the rows unamalgamated are A, Bi, B^ and C respec¬ 
tively, show that the pattern function for the original pattern is 


n 


(n - l)(n - 2) (n ~~ l){n - 2) 


(Bi j- -^s) 


2 


n(n — l){n — 2) 


C, 
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Deduce that the function of the pattern 


X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

• 


+ 

I7n + 2 

(n - mn 

— 

'2)^n - : 


(FiRher and Wishart, 1930.) 


11.12. Show that 


< 11 )=>- 


^ 2 , J 

n - 1 '"“ + ,7 - f 
n - 1 " 


and hence that if P y, 

V(^2fl 

then to order for normal samples 


, and r =. 5 ‘'-> 


p ana r ™ . 

\/(^20^^02) V (”‘*20'‘^02) 


var r — --(1 — p-)^. 
n 

11.13. Show that for a bivariate normal population tu ajid / have zero covariance 
unless f + u -- v -I w. 

(Wishart, 1930.) 

11.14. Show that for a bivariate normal populalion 


27Tai(7..{i — p‘^)l 


2>1 


ffj (r,ffu (T^ 


var (/r,J = Jj ”) --- flu! 




if, 1, p“), 


where is the jth difference of the A’tli power of zero and F refers to the hy})ergeometric 

function. 

(Wishart, 19296.) 

11.15. Use the methods of this chapter to verify that to order ^ * 

var (m 4 ) ^ — /if + 16 / 4/^2 — H/zs/Ca). 

n 


11.16. Referring to Exercise 11.4, show that the moment-generating function 

Tg, . . .) of the statistics ~, 

^* 2 ' ^2 ^ 2 - 

is given symbolically by 

M'ixt, T, . . .) = exp/ra^j + h • • •)> 
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where <» . . .) is i^he moment-generating function of the ^-statistics and is the same 
function of as is of x. 

Noting that in normal samples the distribution of Ic^ is independent of that of the other 

( 2k t n 

1 - show that 

T, . . .) = ft .. •) 

Hence, if the number r refers to ky., that 

)-U 

’(HA 

(t b -j- c “f" . 


where 


/«(. . . .r^S") = /y(. . . 5«4*'3“2“^); 


t(i _ 

t\ n ~\} 


Kn-l) 


and hence that //(. . . 5'^4*'3") 
Deduce that 


/i(. . . 5«4'*3“2 f) 


in - l)(w + 1) 


(w +2^-3) 


(n - ly 




var {~ 

Vi's 7 (n — 2)(« + 1)(» + 3) 

/IcA lOHn^ii ~ 21 n - 70) 

(« - 2)"(« 4 1)(» + S)(H f 5)(Ti 4 l){n + 9)' 

Hence verify the formulae of equations (11.104) and (11.105). (This remarkable result 
is due to Fisher (1930). The independence of k^ and the other statistics may be seen by 
considering the «-fold sami)le apace, k^ appearing as the square of a length and the others 
as angles (ef. Geaiy (1933), Biometrika, 25, 184).) 


11.17. Defining y by the relation 

- l)(ri ~ 2){n - A, 

24.n{ii d 1) Af 

show that the moments of the distribution of y in samples from a noimal jiopulation are 





88 __ .532 

65 4811 

2n Hn ^ 

32,196 , 

_ „ -r 

^2 


136,605 
1,118,388 , 


■) 


(E. S. Pearson, 1930, by the method of 11.23, before the exact results of the previous 
exercise had been given. He fitted a Pearson Tyx)e IV to the distribution by using these 
moments, and tabulated the 1 per cent, and 5 per cent, significance points.) 


A.S. 


U 



CHAPTER 12 


THE X"-distribution 

12.1. Among the sampling distributions of current statistical theory the normal 
distribution is perhaps of widest application in virtue of the tendency of many statistics 
to normality in large samples, in*espective of the nature of the parent population. There 
is one other distribution, closely related to the normal, which has a somewhat similar general 
applicability and we give an account of it in this chapter 

Suppose we have a number of compartments or cells determined by specified ranges 
of a variate-value or by some qualitative character, such as the intervals of a univariate 
frequency-distribution, the cells of a bivariate distribution, or a simple classification of 
individuals into two classes, A and not~u4. Suppose those cells are filled by random 
sampling from a parent population and that in the parent the proportion of members in 
the ^‘th cell is In a sample of 7i there will occur proportions of, say, in the jith cell, 
the observed numbers being accordingly npj. If the sampling w^ere such as to give an 
exact representation of the jmrent these numbers would be vtij. Our fundamental problem 
is to determine how far the npj can, to any acceptable degree of probability, diverge from 
the by random sampling fluctuations. We shall then bo able to test the accuracy 
of the hypothesis on which the :;t’s were determined 

A few examples from material occurring in earlier chapters will illustrate th(‘ ])roblem 
In Table 5.1 on page 117 were given the actual occurrences of throws of dice, ri being 
26,306, the cells being eleven in number according to the number of “ successes,’’ and a 
third column showing the theoretical frequencies based on the hypothesis that the sam¬ 
pling obeyed a binomial law. The observed frequencies are our vp'^ and the theoretical 
frequencies our /?7r’s. The question is, are the differences between the t^^o such as can 
have arisen by sampling fluctuations alone ^ If not, then we must reject our hypothesis 
as to the generation of these dice-throws according to the binomial law. 

Again, in the table of Example 8.6 were shown some results of inoculation against 
cholera. The question which interests us here is whether inoculation does in fact restrict 
or prevent attack. If it does not, wo expect to find the same proportion of attacked in the 
inoculated class as in the not-inoculated class, e.g. the proportion of attacked in the former 
would be -gYy X 279 - 23-5 approximately as against an observed 3. The former number 
is an rm and the latter an np. Once agam w'c should examine the differences, and if they 
wore large enough to be inexplicable on the basis of sampling alone, should reject the hypo¬ 
thesis of independence of inoculation and attack, concluding that inoculation was to some 
extent preventive. 


12.2. Consider then samples of n with a division of the possible classification into 
p cells ; and suppose the members distributed simply at random in these cells. 

Then the probability of there being members in the first cell, in the second, and 
so forth, is the term in . . . in the multinomial form 

(tTi -f TTs + . . . 


T == . 


7C, 


n\ 


290 


V-' 


that ib to say, is 


( 12 . 1 ) 



THE z*-I>ISTEIBUTION 


291 


If the Vb are not small we have, in virtue of Stirling’s approximation to the factorial, 

....... . .( 12 . 2 ) 




and since 72 ^ 27 this becomes 


Now put 
and 

Then from (12.3) we have 


kj ==- U7t^ 




log T — log (constant) — 2’|(Z^ + |) log 


^Uf, 


- - 2;(;. (- H- ft log 1 


(12.3) 


If A is large, f wdll be small compared with A and to first order we have, expanding the 
logarithm, 

log T - log (constant) = — 2:(A + J -{ 

= - + >fv/A I 0(A-»)}.(12.4) 

Now 

2'(^ V^) = - A,.) = ^ - n - 0 

and hence, to order A“*, 

log T — log constant — - 

T ocexp(-- ..... (12.5) 


Hence the frequency T varies as that of th(‘ sum of p normal variates of unit variance which 
are subject to the constraint 2(f \/A) ^ 0 but otherwise independent. 

Now put 

■= .... ( 12 . 6 ) 

A, 

Then the frequency of x '^ is that of the sum of squares of (p — 1) independent normal variates 
of unit variance. Its distribution is then, from Example 10.4, given by 


d{x^) . . . ( 12 . 7 ) 

= — fix- 


. ( 12 . 8 ) 
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Furthermore, if there are certain constraints on the cell frequencies expressible by 
H linear equations among them, the distribution remains of the same form but is now 

^ iJx .(12.9) 

where v, known as the number of degrees of freedom, is p —* /c, that is the number of cells 
whose fi^equencies can be assigned without restriction. (Cf. Example 10.4.) 

12.3. The distribution (12.9) is usually known as the ^-distribution, though it is 
actually that of However, X quantity which always occurs in practical 

calculations and most tables of the distribution function have ih© argument. (12.9) 
is only an approximation, and relies on the fact that for largo A the Stirling approximation 
to the factorial will hold and that deviations from theoretical A’s are negligible to order n""*. 
In point of fact, the approximation is veiy good and the ^-distribution may confidently 
be applied when the theoretical cell frequencies are, say, not less than 20. 

Before dealing with the applications of the above results we will consider in more 
detail the properties of the distribution. 


Froperfieb' of the x^~ 

12.4. Writing ~ C we have for the distribution 

1 


clF 






0 < ^ <-00 


tt Peareon Tyjie III distribution. The characteristic function Ls 


^(0 - .. 
(I - 2il)i 

whence, for the cumulants, we have 

x,. =- V 2’-i(r - 1)! 
and for moments about the mean 


jUi = 2v ' 

fJi = Sr 

48r + 12v* 

yws = S2v {5v + 12) 1 

^ 40r(3r* + r>2v + 96)j 


. ( 12 . 10 ) 


. ( 12 . 11 ) 

. ( 12 . 12 ) 


. (12.13) 


Since is linear in /i^, which can contain only 


T T 

in r, i.e. ~ if r is even and — 


— if r is odd. 


powers of //*, must be of degren^ 


As V tends to infinity the ;^*-distribution tends to normality, for in standard measure 
we have 


r it 

(lift) = e~v(*>'') 



2it \-: 

V(^)) ' 
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log 


— vit 

■^ 7 ( 2 ;-) 

- it*. 


— 2 it 

2\ 



The tendency is, how€>ver, rather slow, and there are better approximations as we shall see 
in a moment. 


12.5. The frequency curves given by (12.9) extend from zero to infinity. In the 
case r = 1 the curve is merely the positive half of the normal curve. In other cases it is 
zero at the origin, rises to a mode and then falls off again to infinity. The maximum ordinate 
of the ;^-difltribution (not the ;f2''distribution) is given by 

- ». 

namely, by 

.(12.14) 


and that of the /--distribution or C-distributioii by 
namely, by 


C=z^- V -2 .(12.15) 

The ■=^ke^vn<*ss of t}i<> f-distributiou in the form (mean— mode)/(standard deviation) is then 

r - (r —“ 1) 1 

x7^ “ vWy 


12.6. The distribution function of (12.10) is an incomplete /^-function. We have 



or, in the notation of Pearson's tables, 

n’ . 

+ 1 ) / 

Some s])ecial tables have, liowc'vc r, bocn constructed. 

(a) Elderton’s table {Tables for (^tatisHciavs and Biometriciayis, Part 1) gives the 

values of P = f dF — I — F{C) “ 1 — F(x^) for values of r — 2 (1) 29 and ~ ^ (^) 1 

J X* 

30 (10) 70. In this table, which is to six places, our v is denoted by «' — 1. 

(h) A table by Yule, reproduced at the end of this volume, suijplements Elderton’e 

by giving P for r .= 1, = 0 (0 01)1 ; 1 (0-1) 10. 

(c) Kelley (1938) gives a four-place table of P for 7 from 0 (0-1) 41 and 1 (1) 10 ; 

V 

12, 10, 19, 30. 

(d) Fisher and Yates (1938) give tables in an inverted form, showing the values of 
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for certain values of P and v, namely P = 0*99, 0*98, 0*95, 0*90 (0*10) 0*10, 0*05, 0*02, 
0*01 and 0*001 ; and = 1 (1) 30. 

(e) Thompson (Biometrika, 32 (1941), 187) gives tables in the inverted form for 
P 0*995, 0*990, 0*975, 0*950, 0*750, 0*500, 0*250, 0*100, 0*050, 0*025, 0*010, 0*005 and 
V 1 (1) 30(10) 100. 

For general use the incomplete i''-function tables are probably the best, as interpolation 
in Elderton’s table does not give very great accuracy. The significance points tabled by 
Fisher and Yates are, however, sufficient for many practical applications of the ;^*-dis- 
tribution in carrying out statistical tests. We reproduce at the end of the volume a diagram 
which will serve for such purposes. It shoM^s, for co-ordinates v and curves 

P = constant, so that for given v and ft is easy to determine whether P falls between 
any of the values for which the curves are drawn. 


12.7, Except for Thompson’s table, the tables do not cover the region for which 
V > 30. and for such values an approximation to the normal distribution may be em¬ 
ployed. There are two such in common use:— 

(a) (Fisher) that is normally distribut(*d about mean \ (2?’ — 1) with unit 

variance ; 


(h) (Wilson and Hilferty (1931) ) that 



is normally distributed about mean I 


2 

9r 


with variance 



in applications. 


The second is more accurate, but invoh^es more aritlimetical work 


The relative speed of approach to normality of x^ <^i^d may be comj)ared as 

follows :— 

For x“ we have, from (12.13), 


Vl -- Vt^L 


>'2 


For the uiomentH of x we have 


Hr __ 12 

2ry \J r 


12 

V 


. (12.17) 
. (12.18) 


Thus 



Using the expansion 


I 
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an extended form of Stirling’s formula, we find after substitution and reduction 

17 


whence 

Also 


Ml 




— - 


i 

4v 32v® 


192r» 


+ . . 


i -,._1 

2 v Sr* 


_87_ 

i92>'» 


+ 


...) 






fU 


tH ^ 

//4 -= {v 4" 2)r 

whence we find for moments about the mean 

^ I 

Hr 

1 

4r-^V 

? . ^ 

4 48r 

Hence for the (‘onstants of \/(^2x^) we have 

1 

4r 

1 


+ 


= 1 


Vi 


\/2r 
31 


f . 


^ 12. ^ 


( 12 . 20 ) 

( 12 . 21 ) 


A compariHon with (J2 17) and (12.18) shows that \/( 2 ;^ 2 j tends to normality with con¬ 
siderably greater rapidity than being only a half and about a quarter of the values 

for the latter distribution. Moreover, the expression for fi\ of x is equal to \'^{v — J) to order 
r““" and hence v i"' distributed about mean A^(2r - 1) to that order, with variance 
which is unity to order r"“^. 


12.8. For the Wilson-Hilferty approximation, consider the distribution of about 

(?)" 


its mean value v. Let us find the distribution of 


y, say, h as yet being undeter¬ 


mined. Write i ^ x^ 


r. Then 

y 


(- ^ D‘ 


= 1 1 ¥ + 

i» 2^ 


(*tc. 


Taking mean values and using the results of (12.13), we find, after some reduction, 

/-.to)=1+*‘*2,"t 

Hh - 1) I , *(» -l)(*-2)^S - 1) 

~ ' 2 ' V 6.2 


h%h 


6.» ' 


3) 


+ o(.-*). 


. ( 12 . 22 ) 
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If in this we put rh — h we find the mean value of and thus 

H' r{y) 


, , rh{rh — 1) 1 
14- ' • -f etc. 

2 V 


We now choose h so that the third term in (12.22) vanishes, i.e. we take h 
then find 

= + ^« + 0(v-‘) 


(12.23) 
I. We 


t^'Ay) = 1 


* - I + 5^5 + S + "I’-** 


/^i{y) 

or, transferring to the mean, 


1 4- 


9v 


4 , 80 , 

3*y» + 37^8 ) 


= aejs + 


/u{y) - 


^6 

3V» 


4- 0(»’-^) 


(12.24) 


We now find 


4 

72 = - „ 
9r 


(12.25) 

(12.20) 


Compaarisou with (12 17). (12.18), (12.20) and (12.21) shows that tends to symmetry, 

as measured by yi, and mesokurtosis more rapidly than either or Vi^X^)- To order 

2 2 

the variance is, from (12,24), equal to — and the mean 1 . The result may also 

Jn' Vir 

be expressed by saying that 


(O' * - -}(?)' 


. (12.27) 


is distributed normally about zero mean with unit variance. 

The following table, quoted from Garwood (1936), shows some comparisons of the two 
approximations with the actual values. In each case there have been worked out the values 


are 


of corresponding to P “ f dF of 0*01, 0*05, 0*95 and 0*99. The exact values 

j 3 ,* 

denoted by m,., those given by Fisher’s approximation and those by Wilson and Hilferty’s 
approximation by , 
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TABLE 12,1 


JP «= 0'99 


P 0-95 


P - 0-01 


P = 0-05 


Comparison of Approximations to the Integral, 
(Prom Gaxwood, Biometrika, 28, 437.) 


V 

rrif 

TYlp 

mT — mp 

mw 

ffif — m 

20 

11 062 

10 764 

0-318 

11*070 

0 012 

30 

J 8*743 

18-414 

0-328 

18-732 

0 010 

40 

26*770 

26-436 

0-334 

26-761 

0-009 

60 

35032 

34 694 

0-338 

36-025 

0-007 

20 

13-266 

13 116 

0-139 

13-254 

0-001 

30 

21 594 

21 466 

0-139 

21-694 ' 

0-000 

40 

30-196 

30-056 

0-140 

30-196 

0 000 

60 

38966 

38 825 

0-140 

38-965 ' 

1 1 

0-000 

20 ^ 

33 103 

32 700 

0-403 

33 113 

- 0-010 

30 

46-401 ' 

45-003 ! 

0*398 1 

45 409 , 

- 0-008 

40 i 

67-347 1 

56-953 1 

0 394 1 

57 355 

~ 0 008 

60 i 

69-067 j 

68-676 

0-391 

. ....i 

69-074 1 

i 

-- 0 007 

20 

29-062 j 

28 919 

0 143 * 

29-060 

0 002 

30 ' 

40-691 

40-548 

0-143 

40-689 

0-002 

40 ' 

52-069 1 

51 926 

0 143 1 

52 068 , 

0-001 

60 

1 

63-287 j 

1 

63 144 

0*143 

1 

63-286 S 

1 

0-001 


The mjy^ ai)proxiniatioii is evidently very good and the approximation is fair. 


12.9, A third method of approximation may be obtained by the method of 
6.32 and 6.33, and in fact our Example 6.5 was virtually based on the p^^-distribu- 

/2 12 48v/2 

tion. Prom equation (6.75) with /j — = 0, Zg = /cs = ^ == ^ > K — —r , 

\j V V V 

=r: we find from (6.73) or (6.75) a normal deviate whose distribution function is 

that of x^. 


Examples of the Use of the x^^Distribution 

12.10. We now proceed to consider some examples of the use of the ;^^*di8tribution 
in comparing observation and hypothesis. 


Example 12 J 

In Table 12.2 we repeat some of the material of Table 5.4, giving the distribution of 
first hands at whist according to the number of trumps held. The observed frequencies 
are our np, = h. The theoretical figures L are based on the hypothesis that the distribution 

follows the hypergeometric series. The last column shows the contributions ^ ^^ 


the total x^* To avoid small frequencies we have grouped together those frequencies 
of 7 or over. 
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TABLE 12.2 

Distribution of First Hands at Whist cbccording to Number of Cards held of a given Suit, 

Hands Dealt but not Played. 


Number of Cards. 

Observed Frequency. 

i 

Theoretical Frequency. 

A 

1 

0. 

1 

i 35 

43 5 

1*661 

1. 

290 

272*2 

1*164 

2. 

1 696 

700*0 

0*023 

3. 

937 

973*5 

1 369 

4. 

851 

811 3 

1*943 

5. 

, 444 

424*0 

0*943 

6 . 

' 115 

141*3 

4*895 

7 and over 

' 32 

34 2 

0*142 

Totau .... 

' 3400 

34000 

1 12*140 


The total is seen to be 12*140. The number of degrees of freedom v is one fewer 
than the number of cells (excluding the total), namely 7. From the diagram in the appendix 
it is seen that the probability of getting a value as great as this or greater on random 

sampling J ^ ^ between 01 and 0*05, very close to the former. The odds 

are therefore about 9 to 1 against getting the observed frequencies or frequencies which 
diverge to a greater extent from theoretical frequencies. This is hardly great enough for 
us to be able to say that an improbable event has occurred, and therefore we need not 
reject the hypothesis that the observed frequencies did in fact arise according to the 
hypergeometric law and that the discrepancies are merely sampling efifects. 

The matter stands differently with the distribution of Table 12.3 showing the distribution 
of 25,000 deals of whist classified in the same way as that of Table 12.2. Here ^ 174*130 

TABLE 12.3 

Distribution of First Hands at Whist according to Number of Cards held> of a given Suit. 

Hands actually Played. 


Numbor of Cards. 

Obsor\(Hl Krequoncv. 

1 

Theoreti(jal Frequency. 

A 

- A)* 

A 

0. 

216 

320 

34*463 

1. 

1,724 

2,002 

38-603 

2 . . . 

5,262 

6,147 

2-669 

3 . ... 

7,440 

7,158 

11*110 

4. 

6,371 

5,965 

27*634 

5.1 

2,960 

3,117 

8*947 

6.I 

852 

1,039 

33*656 

7. 

166 

220 

13 255 

8 and over 

20 

31 

3 903 

Totatw .... 

26,000 

24,999 

174*130 
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and =5= 8 (on© more than in the previous example because we have grouped only those 
frequencies of 8 and over). From the diagram it is clear that the chance of getting such 
a value or a greater one is exceedingly small, certainly less than 1 in 10,000. This very 
rare ©vent leads us to reject the hypothesis that the hypergeometric distribution is operating. 
The explanation is probably that these deals were taken from actual play, whereas those 
of the previous table were obtained without actually playing the hands. It is evident 
that in card play cei^tain kinds of card (e.g. those of the same suit) tend to collect together 
and the shufHing is apt to be somewhat perfunctory. Thus the condition of realisation of 
the hypergeometric distribution, that the selection is random, was probably violated. 

Example 12.2 

In some classical experiments on pea-breeding Mendel obtained the following frequencies 
for different kinds of seeds in crosses from plants with round yellow seeds and wrinkled 
green seeds :— 




(,)bserved 

Theoretical 

HouikI and yellow . 


. 315 

312 75 

Wrinkled and yellow 


(01 

104-25 

Round and green 


108 

104 25 

Wrinkled an<l green 


32 

34 75 


’’J'OTAL . 

. r)5(; 

556 00 


On the Mendelian theory of inheritance the frequencies should be in proportion 9, 3, 3, 1 
and the theoretical frequencies are shown in the last column. 

We find 


2 _ (2-25)2 (3-24^)2 ^ (3-75)2 (2-75)2 
" ^ 312-75 ^ 104-25 ' 104-25 ' 34-75 


0-4700. 


The number of degrees of freedom r = 3. The probability of obtaining the value oi 
or greater is seen to be between 0-9 and 0*95. There is thus nothing in the value of to 
lead us to reject the Mejidelian hypothesis. 


12.11. Consider now a table of the type of Table 12.4, which shows the frequencies 
of a number of men according to eye colour and hair colour. If, on some hypothesis as 
to the relationship between eye and hair colour we determine theoretical frequencies in 
the body of the table, leaving the row and border columns unchanged, then there are 
a number of linear constraints on these frequencies. 

In fact, if in such a table there are r rows and 6* columns it will be found that only 
(r — 1)(5 — 1) cells can be filled up arbitrarily. There are rs cells altogether ; but the fact 
that the rows and columns must add to assigned totals imposes r -f- s constraints. These, 
however, are not independent, for the sum of the border column frequencies is equal to 
that of the border row frequencies and thus there are only r + .s' 1 independent linear 

constraints. Hence rs — (r -f 6f — 1) = (r — !)(« — 1) cells are independent and this is r, 
the number of degrees of freedom associated with such a table. 

Example 12.3 

In Table 12.4 suppose that eye and hair colour are independent. Then the expected 

xy 

frequency in any cell with a row total x and a column total y will be , where n is the 
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TABLE 12.4 


Distributimi of 6800 Males according to Cohw of Eye and Hair, 
(Ammon, Zur Anihropologie der Badener,) 

Hair colour 



Fair. 

Brown. 

Black, 

Red. 

Totals. 

Blue 

1768 

807 

189 

47 

2811 

Groy or Green 

946 

1387 

746 

1 

53 

1 

3132 


! 

1 



1 __ ; 

- 

Brown .... 

IJ5 j 

438 

j 288 

1 

i 

1 

857 

Totals 

2829 

1_ 

2<!32 

j 1223 

1 _ 

116 

. 6800 

L. 


total frequency. For instance, the expected number of men with fair hair and blue eyes is 
2811 X 2820 

- -- ~ 1169. The theoretical frequencies obtained in this way are— 

6800 ^ 


Hence 



Fair 

Brown 

Black 

Rod 

Blue . . . . 

1169 

1088 

506 

48 0 

Gioy or Grvoti . 

1303 

12J2 

563 

53 4 

Brown 

357 

332 

154 

14 6 


_ ,,( 1768 -^ 1169 )^ 

^ 1169 

^ - 1075 - 2 . 

^ (4 — 1)(3 - 1 ) = 6 . 


The value of is very improbable, P being less than 0 000,001 We accordingly reject 

the hypothesis of independence and conclude that hair colour and eye colour are associated. 


12.12. It is useful to note that x^ may be put into a form which is sometimes more 
convenient for calculation. We have 

y* - 

' 7 * 

- Z ~ - 211 I LX 
X 

~ - n .(12.2H) 

A 

When the A’s are not integers it is easier to work with this formula, the squaring of the 
larger numbers I involving less arithmetic than the squaring of the smaller but non-integral 
numbers I — A. 


12.13. In the foregoing examples the theoretical frequencies A were calculated without 
reference to the experimental data other than totals which merely subjected them to linear 
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^oriistrajnt^ md hence preserved the Type HI distribution of There also arises the 
much more difficult case in which certain parameters necessary for the determination of 
the theoretical frequencies have to be determined from the data themselves. Suppose, 
for example, we attempt to represent a frequen^jy-distribution by a normal curve. We 
have then to decide on the mean and variance of this curve, and they can, as a rule, only 
be estimated from the data themselves. The question then arises, what happens to the 
;^*-distribution if, instead of the unknown parameters leading to the theoretical frequencies A, 
we use estimates leading to the estimated theoretical frequencies, say, That is to say, 
how does the distribution of the statistic 

^ “ A 

compare with that of 

.(12.29) 

This problem has not yet been completely solved. The nearest approach to a solution 
has been reached by R. A. Fisher (1924)| who showed that xl is distributed in the Type III 
form, provided that 

(а) the sample is large and that each cell-frequency is large ; 

(б) that the number of degrees of freedom is reduced by imity for every parameter 
estimated : 

^ (e) that the prmcij)le of estimation involved is such as to minimise x^* This is 
equivalent, for large samples, to taking a maximum likelihood estimate. 

Imparting from our usual practice, we shall have at this stage to state this result 
without proof. It cannot be adequately discussed until wo have dealt with the principles 
of estimation in the second volume. 

Example 12,4 

The following table shows the distribution of 12 dice thrown 26,306 times, a 5 or 6 being 
reckoned a success. We have encountered these data before in Table 5.1. 


TABLE 12.5 

Distributioji of 12 Dice ihromx 26,306 limes, a 5 or 6 being reclcan^ed a Success, 


Number of 

Observed 

Frequency of 

Frequency of 

Successes. 

Frequency, 

26,306(5 + 5)**. ' 

_ 

26,306(0 6623 + 0 3377)“. 

0. 

185 

203 

187 

1. 

1,149 

1,217 

1,146 

2. 

3,2«r> 

3,345 

3,215 

3. 

5,475 

5,576 

5,465 

4. 

6,114 

6,273 

6,269 

5. 

5,194 

5,018 

5,115 

6. 

3,067 

2,927 

3,043 

7. 

1,331 

1,254 

1,330 

8. 

403 

392 

424 

9. 

105 

87 

96 

10 and over . . . . | 

IS 

14 

16 

Totals 

26,306 

1 

26,306 

26,306 
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The third column shows the frequencies if the dice were perfect, that is the frequencies 
of the binomial law 26,306 (? + *)**. We find, in the usual way, 

= (203_- + e,,. = 35.941. 

^ 185 

V == 10. 

jP is very small, less than 0*000,1 and we conclude that the hypothesis is to be rejected, 
i.e. that the dice were not perfect or that something was wrong with the sampling. In 
this particular case great care was in fact taken in rolling the dice and the balance lies in 
favour of rejecting the hypothesis that they were entirely unbiassed. 

Let us then reconsider the data. If the dice are biassed, what is the true probability 
of getting a 5 or 6 ? This we must estimate from the data and it has already been seen 
that a maximum likelihood estimate is the mean number of successes in the sample itself. 
This is found to be 0-3377 and the last column in Table 12.5 shows the frequencies 
26,306(0*6623 + 0*3377)^^. The agreement with observation is evidently closer and we 
find now = 8*201. v is now 9, for we have estimated one parameter. P is now about 
0*5, so that the observed frequencies are in quite good accord with theory. 

12.14. Since is the sum of a certain number of normal variates each with zero 
mean and miit variance, a number of different values of wiay be added together and 
will be distributed in the Type III form with a number of degrees of freedom equal to the 
sum of the individual numbers. This i*esult enables us to combine the results of a set of 
experiments so as to determine the probability of the whole set taken together. For 
example, Table 12.6 shows the data for inoculation against cholera on a certain tea estate. 

TABLE 12.6 

Inoculation agatruit Cholera on a certain Tea Estate. 




Attacked. 

Not Attacked. 

Totals. 

InoculaleO 


431 

1 

5 

430 

Not moeulatod 


291 

' 9 

300 


Totals 

722 

! 

1 14 

730 


We find x^ == 3*27, r ^ i and P, from Appendix Table 7, about 0-071. This is 
small, but not small enough to reject the hypothesis, particularly when we note that 
the theoretical frequencies in the not-attacked column are far from largo. 

The results for six such estates were :— 



F 

V 

3 27 

0 071 

1 

9 34 

0*0022 

1 

0 08 

0 014 

1 

2 61 

0 11 

J 

5 61 

0 018 

1 

1*69 

0 21 

1 

28 40 


0 


Here only one value of P is less than 0*01, and we might be inclined to doubt the reality 
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of association between inoculation and immunity. The sum of is, however, 28»40, and 
V 6, for which values we find P < 0*000,1 j so that together the results are significant. 


The. 2x2 Bivariate Table 


12 . 15 . We now return to a point which has been mentioned incidentally. If the 
theoretical frequencies in cells are small, the Type III distribution will hold only as an 
approximation depending on how closely the binomial distributions in individual cells are 
adequately represented by normal distributions. For some problems we can overcorpe the 
difficulty by grouping small frequencies, as haa been done above in Example 12.1. But 
such a process sacrifices information and cannot always be carried out, e.g. in a 2 x 2 
bivariate table. 

Consider in the first place the symmetrical binomial (\ +4)’®. The second column 
in the following table shows the probability P that the number of successes in the first 
column will bo at least attained (for the smaller of the pair) or attained or exceeded (for the 
larger of the pair). 


SuCC(^S 80 S 

P 

Pi 


0, 10 

0 0010 

0*0008 

0*0022 

h 9 

00108 

0 0057 

0*0134 

2, 8 

0*0547 

00290 

0*0509 

3, 7 

0*1719 

0*10.30 

0 1714 

4, 0 

0 3770 

0 2035 

0 3759 


If we regard this frequency as that of a single cell (v = 1) we should, for the corre¬ 
sponding ^.distribution, have the positive half of the normal curve. The values correspond¬ 
ing to x^ shown in the third column as P^. They may be obtained 

from Appendix Tables 6 and 7, e.g. for the last term we have x^ ~ 'i — 0*4, P == 0*52709, 
Pi = I of this = 0*2635. 

The correspondence between P and Pi is evidently not very good. We can, however, 
improve it considerably by a correction due to Yates (1934). Tlie distribution of x^ is 
continuous, whereas that of the binomial is not. To bring the two into comparability 
we really should consider the binomial frequency at the value r as spread over the range 
r — I to r + I ; or, what comes to the same thing, we should take x^ half a unit less than 
the observed value in applying the Type III distribution. For example, for a deviation 3 

2(2*5)^ 

corresponding to 8 successes we should take a deviation 2*5, giving x^ r ~ 


instead of 3, The values given by the corrected x^ shown as Pa above. The agreement 
between Pa and P is evidently a great improvement on that between and P. 

When the theoretical proportion in a cell is not J, the binomial distribution is skew, 
and there do not appear to bo any simple corrections to compensate for this efi’ect. The 
continuity correction will, however, result in an improvement if the theoretical frequency 
is nnar | and is probably best made in all circumstances. 

12 . 16 . The 2x2 table may also be dealt with b^^ exact methods. Consider in fact 
the table 


a 


c 


b j a -f 6 

I 

d ^ r \~ d 


n 


a ~\ c 


6 + c? ‘ 




1 
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If the two variates are independent, the number of ways in which a table with such 
marginal totals can be constructed from the n sample members is 
/ n \/ r#. \ _ n\ n\ 

^(2 'f- cy yc? "f" ifl' “f" ^)* 4“ ^)* (c c?)! 

Tlie number of ways in which the body of the array can be completed is 

a! 6! c! d\' 

Consequently the probability of the distribution of the table is 

{a + c)! (6 -f d)\ {a + 6)! (c + d)\ 

a\b\c\d\ - * • • \ ) 

Thus the successive probabilities for r/ = 0, 1, 2, . . . are the successive terms in the 
h 3 rpergeometric series 

F[~- (c +d), - (b +d), u - rf -f 1, 1}. . . . (12.31) 

Example 12.5 (from F. Yates, 1934, quoting data by M. Heilman). 

The following table shows the number of children classified according to the nature 
of the teeth and type of feeding. 


i 

Normal T<3etli. 

1 Mnloecluded Teeth. 

Totai^. 

1 

Breast fed 

1 

4 

16 

! 

20 

1 

Bottle fed . . . ^ 

\ 

1 

21 

1 

22 

'i'OT-VlwS 

5 

> " 1 
1 

37 

42 


From (13.38) the probability of obtaining no normal breast-fed children if the attributes 
are independent is (a ~ 0) 


5!^7|20! 22! 
42!TorO! 5! 17! 


0*03096. 


The probabilities of obtaining 1,2,.., children are obtained by multiplying successively 

, r, X 20 4 X 19 3 X 18 , , ... 

by - —, - , - — , and so on, and are as follows :— 

‘ J < 18 2 X 19 3 X 20 


Ninnbor of Normal 
Brea St - fed Chiklron. 
0 
1 
o 

3 

4 

5 


Probabilit y. 


00310 
01720 
0-3440 
0-309<5 
0-1253 
0 0182 


1-0001 

Thus the probability of getting four or more nonnal breast-fed children is 0-1436, and 
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conclude that there is nothing to reject the hypothesis that breast feeding exerts no 
effect on the condition of the teeth. Had we used the test in the ordinary way we 
should have found P = 0*0612, less than half the true value. The continuity correction 
makes a great improvement, giving P = 0*1427. 


NOTES AND REFERENCES 
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EXERCISES 


12 . 1 - 


By the method of 12.8 show that 



is approximately normally distributed with unit variance about zero mean. 

(Haldane, 1939.) 


12•2. Use the ;f2-distribution to show that the distribution of digits from telephone 
directories (Table 1.4) could not in all probability have arisen by random sampling from 
a population in which each of the ten digits occurred with the same frequency. 


12.3. 


where 
two rows. 


Show that for a 2 x bivariate table v = n — I and 



ajy are the frequencies in the ^*th column and ni^ are the border sums of the 


12.4. Show that if v is even 

^ = - c 2 ^'-1 dx 

j X 

= + . . . - - ) 

V 2 2.4 6 ... (v - 2)/ 

and hence that the values of P for given be derived from tables of the Poisson 

exponential limit. 


12.5. Show that in a 2 x 2 table whose frequencies are 


a 


b 


c I d 

2 (g - f 6 4 C + d){ad — bc)^ 

^ (a + b)(c 4- d)(b 4^ +~c) 

the theoretical frequencies being those obtained on the hypothesis that the two variates 
are independent. 

12.6. An experiment gives on hypothesis H ^ When repeated it gives 

the same result. Show that the two taken together do not give the same confidence in 
H as either taken separately. 
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12.7* (Data from Report on the Spahlinger Experiments in Northern Ireland, 193J- 
1934, H.M. Stationery Office, 1936.) In experiments on the immunisation of cattle from 
tuberculosis the following results were secured :— 



Died of Tuberoulosih 
or very seriously 
affected. 

Unaffected or only 
slightly affected. 

Totals. 

Inoculated with vaccine . 

6 

13 

19 

Not inoculated or inoculated wjth 


i 


control media. 

8 

3 

11 

Totai.8 

_ 

14 1 

10 

30 


Show that for this table, on the hypothesis that inoculation and susceptibility to 
tuberculosis are independent, ^ 4 . 75 ^ P = 0‘029 ; uith a con*ection for continuity 
P ^ 0*039 ; and that by the exact method of 12,15 P = 0 * 036 . 

12.8. (Data from Yule, Jour, Anihrop. Inst., 1906, 36, 325.) 

Sixteen pieces of photographic paper were i>rinted down to diflforent depths of colour 
from nearly white to a ver^ deep blackish-brown. Small scraps were cut from each sheet 
and pasted on cards, two scraps on each card one above the other, combining scraps from 
the several sheets in all jjossible ways, so that there were 266 cards in the pack. Twenty 
observers then went through the pack independently, each one naming each tint either 
‘‘ light,’’ medium ” or “ dark.” 

The following table shows the name assigned to each of the two pieces of paper :— 


Name assigned to 
Lower Tint. 

Name assigned to Upper Tint. 

Light. Medium. | Dark. 

To PALS. 

Light 

850 

571 

580 

2001 

Medium . . i 

j 

018 

693 

455 

1000 

Dark 

540 

450 

457 

1453 

Totals 

2008 

i ^ 

1020 

1 

! 1492 

5120 


Show that there is a significant association between the name assigned to one piece 
and the name asvsigned to the other. 







CHAPTER 13 


ASSOCIATION AND CONTINGENCY 

13.1. This and the next three chapters deal with the relationship between two or 
more variables. We shall consider populations, the members of which each bear one of 
each of several different sets of qualities or one value of each of several different variables, 
and shall discuss the measurement of the relationship among the qualities or variables 
in the populations. The corresponding questions of sampling will also fall for consideration. 
We may denote this branch of the theory by the general name of Theory of Dependence. 

AsBociatioyi 

13.2. Consider in the first instance a population classified according to whether 
each member bears or does not bear an attribute A The presence of the attribute we 
may denote by A and the absence by a. We shall assume that each member must either 
be an A or an a, so that a — not-^ and A ~ not-a. 

Suppose that each member of the population is classified according to two attributes 
A and JS. Each may then be one of four kinds, AB, A/9, cdB and a/S. For example, if the 
attributes are the possession of blue eyes {A) and the possession of male sex [B), we shall 
have the four possible classes AB = blue-eyed males, A/9 == blue-eyed females, olB == not- 
blue-eyed males, a/8 — not-blue-eyed females. Denoting the number in any class by the 
letters appropriate to that class in ordinary round brackets, we may then specify the 
population in the tabular form :— 




not B'b 

Totals 

A’s 

(AB) 

(^p) 

(A) 

not'J. ’b 

(aB) 

(a.P) 

(a) 

Totals 

(B) 

(P) 

N 


or, more simply, by 


~ 


-- — ' — 

a 

b 

a f 6 

- 

— 

— 

c 

d 

c + 

d -f- c 

h 

N 


where a = (AH), etc. Here N is the total number in the population. 
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c 

d 

c -f- d 

Of ”4“ c 

6 + d 

^ “V 

a 

c 

a c 

a -f- 6 

c d 


b 

_ ^ 

h "4" d 

a + b 

c + d 

^ N 


13 A. If ihere is no relationship between the attribute A and the attribute B, that 
is to say if the possession of A is irrelevant to the possession of B, then there must be 
thb same propiwtion of A’s among the B’s as among the jS’s. We thus define two attributes 
to be independent if 

{B) {p)~ . 

(I b (I b 

o +‘c "" 6 f . 

It follows at once that each of the following is true :— 

.(13.5) 

.(13.6) 

.(13.7) 

Thcvse are derivable by simple algebra from (13 4) and, in words, will be found to express 
the same fundamental fact that the proportion of members bearing an attribute X is the 
same among the 1^’s as among the not-Y’s. It also follows that 

(«r + d) 

N .... 

with three similar equations in 6, c and (L 
If now in any given table 

(a + b)(c + d) 

N .... 

or, in the alternative notation, 

(AB) > . 

A 

we shall say that A and B are positivelv associated. Per corttra, if 

.... 

they are said to be negatively associated or disassociated. 


a = 


«> 


. (13.8) 

. (13.9) 

(13.10) 

(13.11) 


Example 13.1 

Association between inoculation against cholera and exemption from attack. (Green¬ 
wood and Yule (1915), Proc Roy. Soc. Medicine, 8, 113 ) The following table shows 818 



•'— — 

—- 



Not Attacked. 

Attac kod. 

To TALS 

Inoculated .... 

27() 

3 

279 

Not-moc'ulated . 

473 

[ 

* (>(i 

539 

XOTAlvS , 

749 

i 

1 *>9 

818 
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cases classified according to inoculation against cholera (attribute A) and freedom from 
attack (attribute B). 

If the attributes were independent the frequency in the inoculated-not-attacked class 
279 X 749 

would be ' = 265. The observed frequency is greater than this and hence in- 

olo 

oculation is positively associated with exemption from attack. 


13.4. The reader will recognise in this example a type of 2 x 2 table which was 
discussed in connection with the ^^^-distribution. In fact, if the data are considered as a 
sample there arises at once the question how far the positive association, which certainly 
exists in the sample, is indicative of real association in the parent population. The 
distribution, as shown in the previous chapter, provides an objective method of forming 
a judgment on this matter, itself, how’^ever, does not provide an adequate measure of 
the intensity of the association. Altogether apart from sampling questions, we sometimes 
wish to compare the strength of associations in different populations or between different 
attributes, and some coefficients proposed for the purpose will now be considered. 


13.5. The more obvious desiderata in a coefficient-measuring association are (a) 
that it shall vanish when the attributes are independent; (6) that it shall be + 1 when 
there is complete positive association and — 1 when there is complete negative association ; 
(c) that it should increase as the frequencies proceed from dissociation to association. As 
to this latter point, consider the difference between observed and “ independence 
frequencies in the cell corresponding to (AB)y viz. :— 

6 == {A B) - .(13.12) 


Since the border frequencies are constant it is evident that the difference in any cell between 
observed and “ independence ’’ frequencies is ± <5 and thus 6 determines uniquely the 
departure from independence. We may interpret condition (c) as meaning that our co¬ 
efficient should increase with 6. It may be noted that 

<5 = a — ~ ~ 

(t -f- h -f- c -f- d 


ad — be 

™ A. 

Following Yule (1900, 1912) we define the coefficient of association Q by the equation 

ad - he Nd 
ad 4“ be ad -f 6c ’ 


Q 


(I3.i;i) 


(13.14) 


It is zero if the attributes are independent, for then 6 ™ 0. It can equal + 1 only if be - - 0, 
in which case there is complete association (either no a’s are or no .4's are /5’s), and — 1 
only if (ui = 0, in which case there is complete disassociation. Furthermore, Q increases 

with 6, for if e ■= — 
ad 


then 




1 


and ~ is negative, as is so tliat is positive, 
de da dd 
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A somewhat similar coefficient, also due to Yule, is the coefficient of colligation 

This also satisfies our conditions, as the reader may verify for himself. 


(13.15) 


13*6* Yet a third coefficient, which will be shown below to be related to i* 

NS 


This is evidently zero when d 


+ V(A)(a)(Bm 
__ {ad — be) 

T {(flr + b){a +c){b + d^{c d)}* 

0 and increases with <5. If F = 1 we have 


(13.16) 


giving 


{a 4 b){a + r){b + d){c + d) - (ad — fee)*, 

^abed + a^{bc f 4* cd) + b^{ac + f od) 

-f- c^(ab + ad bd) -f- d%ac -\- ab + be) — 0. 


Since no frequency can be negative this can only vaniffi if at least two of a, 6, c, d are zero. 
If the frequencies in the same row and column vanish the case is purely nugatory. We 
have then only to consider a ~ 0, r/ = 0 or 6 = 0, c = 0. In the first case F = 1, in the 
second F == — 1. It cannot lie outside these limits. 


13.7. It will be observed that whereas F is unity only if two frequencies in the 2x2 
table vanish, Q and Y are unity if only one frequency vanishes. This raises a point in 
connection with the definition of complete association. We shall say that association is 
complete if all A's arc B's, not^thstanding that all B's are not A's, If all dumb men 
are deaf there is complete association between dumbness and deafness, however many 
deaf men there are who are * not dumb. The coefficient F is unity only if all A s 
are B's and allJS’s area’s, a condition which we could, if so desired, describe as absolute 
association. 

It is necessary’’ to point out in this connection that statistical association is different 
from association in the colloquial sense. In current speech we say that A and B are 
associated if they occur together fairly often ; but in statistics they are associated only 
if A occurs relatively more or less frequently among the JS’s than among the not-B s. If 
90 per cent, of smokers have poor digestions we cannot say that smoking and poor digestion 
are associated until it is shown that less than 90 per cent, of non-smokers have poor 
digestions. 


Example 13.2 

Consider again the data of Example 13.1. For the various coefficients we have 


(276 X 66) - (3J< 473) 


= 0-8555 



312 


ASSOCIATION AND CONTINOENCY 


Y 




1 + 


V: 


3 X 473 
276_>^66 
3'x 473 
276 X 66 


0-6636 


V = X -I. (3 X 473) _ 
V'(279 X 639 X 749 X 69) 


These values are, os might be expected, different, although they all refer to the same intensity 
of association. Comparisons, however, naturally fall to be made between values of co¬ 
efficients of the same type, and the fact that different types give different values does not 
affect their usefulness or the comparability of members of any one t 3 Tpe. 


13.8. The methods of Chapter 9 may be used to give the standard errors of the three 
coefficients based on material obtained by random sampling. 

We recall that for any of the four frequencies a, b, c, d we have results such as 

a(N — a) 

'N 


var a — 


. (13.17) 


cov (a, b) — 


ab 

N' 


. (13.18) 


The first is merely another way of writing the expression for the variance of a binomial. 
The second follows from 

0 = var (a -f 6) = var a + var 6 + 2 cov (a, 6). 

Then for a = — we have, writing A for the differential to avoid confusion with the 
frequency d, 

Aa Ah 


Ae Ab ^ Ac ^ _ 

cheat 


whence 


var E 


, var a 

n.^ 


+ 2 1'\± 


cov(er, 6) 
ab 


Substitution from (13.17) and (13.18) gives 

var e=:e*{-+ 

\a h c a) 


(13.19) 


Now 

and hence 
giving 

In a similar way we have 


Q - 

AQ _ 

Q 

var Q = 


1 — e 

r+ e 

_ 2 Az 

1 - f* 

4Q^ var e 
(1 - tT 

(1 - go)Yi ^ 1 


var Y 


(1 - YW , 1 , 1 , 1 \ 

> [a ^ b ^ c ^ d)' 


16 


(13.20) 

(13.21) 
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Th^ sampling variance of F may be fonnd similarly but involves rather more lengthy 
algebra* Yule (1912) gives the result 


var V 


1 

N 




1 - F* + (F + iF3) 


{{a + b){a -|~ c)(b + d)(c + d)}^ 


^ ^ d)* (a 4* c —- 6 — d)®"}*! 

^ \~(a + b){c+dj (a + c)ib^+d) jJ • 


(13.22) 


In applying these formulae it is, as usual in large-sample theory, assumed that the 
observed frequencies may be used instead of theoretical frequencies in the sampling 
variances. 


Example 13,3 

Reverting to Example 13.2, we have for the standard error of Q 


2 ^ VG + 6 + 'c + 

1 - (0 S.“>r,r))* // 1 

2 V \27 


-f i + ^ f -1. 

276 3 473 66 




0 0798 . 


The coefficient Q thus probably lies in the range 0*856 i 0*239 in the population from 
which these data were derived, assuming of course that the sampling was random. 


Partial Association 

13*9* The coefficients described above measure the dependence of two attributes in 
the statistical sense, but in order to decide whether such dependence has any causal signifi¬ 
cance it is often necessary to consider associations in sub-populations. Suppose, for 
example, a positive association is noticed between inoculation and exemption from attack. 
It is natural to infer that the inoculation confers exemption, but this is not necessarily so. 
It might be that the people who are inoculated are drawn largely from the richer classes, 
who live in better hygienic conditions and are therefore better equipped to resist attack 
or less exposed to risk. In other words, the association of .4 and might be due to the 
association of both with a third attribute C (wealth). 

Now it is clear that this explanation would not hold if the hygienic circumstances were 
constant in the population. If we then consider the association of A and B m the sub¬ 
populations {0) (well-to-do classes) and (y) (poorer classes) and find that it persists, the 
explanation is rejected. Furthermore, if the association in (y) was weaker than that 
in (C), there would be some indication that hygienic conditions are related to exemption 
from attack, though not constituting the only factor concerned* 


13.10. Associations in sub-populations are called partial associations Analogously 
to (13.9), A and J3 are said to be positively associated in the population of C’s if 


(ABC) > 


(AC)(BC) 
(C) ' 


. (13.23) 
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where {ABC) represents the number of members bearing the attributes A, B and C ; and 
so on. We may also define coefficients of partial association, colligation, etc., such as 

_ (ABOioLfiC) -- (ApOi^BC) . 24 ^ 

Qab c - ^ (AfiOi^BG)^ • • ■ 

which is derived from (13.14) by adding C to all the symbols representing the frequencies. 


Example 13,4 

Galton’s Natural Inheritance ” gives some particulars, for 78 families containing not 
less than six brothers or sisters, of eye-colour in parent and child. Denoting a light-eyed 
child by A, a light-eyed parent byjB and a light-eyed grandparent by (7, we trace every 
possible line of descent and record whether a light-eyed child has light-eyed parent and 
grandparent, the number of such being denoted by {ABC) and so on. The symbol (A)9y), 
for example, denotes the number of light-eyed children whose parents and grandparents 
have not light eyes. The eight possible classes are 


{ABC) == 1928 
{ABy) = 596 
{A/iC) = 552 
{Apy) == 508 


{qlBC) == 303 
{oBy) = 225 
{(xPC) = 395 
{(xpy) = 501 


The first question we discuss is : does there exist any association between parent and 
offspring with regard to eye-colour ^ We consider both the grandparent-parent group 
(association of J5’s and C’s) and the parent-child group (association of A’s and We 

have, for the former: 

Proportion of light-eyed among children of light-eyed parents, 


{BC) 

(C) 


2231 

3178 


=r 70 2 


per cent. 


Proportion of light-eyed among children of not-light-eyed parents, 


(By) _ 821 
Ty) ” 1^30 


= 44-9 per cent.; 


and for the latter, analogously, 

(AB) 

(B) 

{Aft) 

m 


2624 

m2 

1J060 

1956 


— 82-7 per cent. 
= 64-2 per cent. 


Frequencies such aa (A^) are calculable direct from the eight classes given above, e.g. 
(Afi) = (AfiC) -4 (A^y) = 562 + 608 = 1060. 

Evidently there is some positive association between parent and offspring in regard to 
«ye-colour. 

Consider now the relationship between eye-colours of grandparents and grandchildren. 
We have: 

Proportion of light-eyed among grandchildren of light-eyed grandparents 


(AC) _ mo 
(C) “ §178 


== 78-0 per cent. 
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Pi?oportion o$ light-^yed among grandchildren of not4ight*eyed grandparents 

^ (A)^) ^ 1104 
iyf 1830 


60*3 per cent. 


The association between grandparents and grandchildren is also positive. 
In tabular form the data are :— 


Grandparents. 


Parents. 



C 

y 

Totals. 

B 

2231 

821 

3052 


947 

1009 

1956 

Totals 

3178 

1830 

5008 



B 

p 

I 

Totai-s. 

A 

2524 

1060 

3584 

a 

528 

896 

1424 

Totals 

i 

3052 

1 

1950 

5008 


Grandpai onts. 



C 

y 

1 

Totals. 

A 

2480 

1104 

3584 

a 

698 

1 726 

i 

1424 

TOI ALS 

3178 

1830 

5008 


The coefficients of association Q and Y are 


Q Y 

CirandpaientH —paionts . , . . .0 487 0 2G0 

Parents—children ... . . 0 603 0 336 

Grandpai ('lit s—grandchildren . . , .0 401 0 209 

Now the question arises : is the resemblance between grandparent and grandchild due 
merely to that between grandparent and parent, jf)arent and child ^ To investigate this, 
we must consider the associations of grandparent and grandchild in the sub-populations 
“ parents light-eyed ” and “ parents not-light-eyed,” that is, the associations of A and C 
in B and We have .— 


Parents Light-eyed 


Proportion of light-eyed amongst grandchildren of light-eyed grandparents 


(A^C) 

JBC) 


ms 

mi 


= 86*4 per cent. 
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Proportion of light-oyed amongst grandefaildren of not-light-ey®d grandparents 


{ABy) _ 696 
\By) 821 


= 72-6 per cent. 


Parents not Light-eyed 

Proportion of light-eyed amongst the grandchildren of light-eyed grandparents 


(AfiC) ^ 662 
'(/?C) 947 


== 68-3 per cent. 


Proportion of light-eyed amongst the grandchildren of not-light-eyed grandparents 

50-3 per cent. 


m 


508 

ioo'o 


In both cases the partial association is well marked and positive. The association 
between grandparents and grandchildren cannot, then, be duo wholly to the associations 
between grandparents and parents, parents and children. There is ancestral heredity, as 
it is called, as well as parental heredity. The relevant four-fold tables are :— 


Parents light-eyed Parents not-hght-eyed. 

Grandparents. Grandparents. 



BC 

By 

Totals. 



pc 

. 

Totals. 





§ 





AB 

1028 

596 

2524 

1 

Ap 

552 

608 

1060 

— -- 

-— 


- 

'i 

— 


_ 

1 

” 

aB 

303 

225 

528 

1 

i ocp 

395 1 

1 

601 

896 

Totals 

1 

2231 1 

! 

821 

3052 

TOTAIiS 

947 

1 

1009 

i 

1966 1 


The coefficients of association and colligation arc :— 

Qacb ^‘^ 12 , Qac^^ 0*159 

0*216 0*080 


13.11. If there are p different attributes under consideration the number of partial 
associations can become very large, even for moderate p. For example, we can choose 

two in ways and consider their associations in all the possible sub-populations of the 

other {p — 2), which are seen to be 3^* in number. Thus there are ^ 2 )^^ associations. 
In practice, however, we need only consider a few of them. 
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f* 


Olie restilt iu'tinis connection is worth noticing. We have, generalising d of equation 
(13.13) 


^ABO + ^ABl 


4- [iABy) - <«} 


mC)(AC) (AHBKOr 

N “ *.V ' 


^AB 

»AB 


y){ 


{AC) - 

^AC ^BU 


{A){C) 
N 


'}{ 


{BO - j 


_N 
(G){y) 

_N 
(C){y) 

If, then, A and B are independent in both (C) and (y), 6^g (. = dj^ y 

N , , 


0 and 


^AB 


iC){y) 


\4C ^BC, 


(13.25) 


(13.26) 


i.e. they are not independent in the population as a whole unless C is independent oi A ov B 
or both in that population. 

This peculiar result indicates that illusory associations may arise when two populations 
{C) and (y) are amalgamated, or that real associations may be obscured. If A and <7, 
B and C\ are associated we have, from (13.25), 

^AB === (C)(y) ^ ^ABC + ^ABy 

SO that even if A and B are independent in (C) and (y) they will appear as associated in 
the two together. Again, if A and B are associated positively in (C) and negatively in (y), 
dj^js may be zero, that is to say, they may appear as independent in the whole population. 


Example 13.5 

Consider the case in which a number of patients are treated for a disease and there 
is noted the number of recoveries. Denoting A by recovery, a by not-recovery, B by 
treatment, /? by not-treatment, suppose the frequencies are 



D 

li 

Tot\^1mS. 

A 

100 

! 

200 

300 

a 

1 

50 

_ 1 

100 

1 150 

1 

TotaIvS I 

150 1 

1 

300 

1 

1 450 


Here {AB) =» 100 = so that the attributes are independent. So far as can be 

seen, treatment exerts no effect on recovery. 
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Denoting male sex by C and female sex by y, suppose the frequencies among males 
and females are 


Males Females 



BO 

pc 

Totals. 



By 

i 

i Py 

Totals. 

AC 

80 

100 

180 


Ay 

20 

, 100 

120 

olC 

40 

80 

120 


cty 

10 

20 

30 

Totals 

120 

180 

300 


Totals 

30 

120 ( 

i 

150 


In the male group we now have 

_ (80 ^80)^(10^X_4jO) 

VABC ^ gQJ ^ 

and in the female group 

QAB,y ~ 0*429. 

Thus among the males treatment is positively associated with recovery, and among the 
females negatively associated. The apparent independence in the two together is due to 
the cancelling of these associations in the sub-populations. 


Cmiiingency 

13.12. We now turn to the more general case in which a population is divided into 
a number of categories Ax, ^ • A^j instead of simply dichotomised into two, A and 

not-^. If there is a second classification into J?i, the frequencies may be 

arranged in the form :— 


1 

1 

1 


A, ... 

1 

Ap 

1 Tdtal'^. 

1 

1 

B, ; 

(A^B,) 

1 1 

(A,B,) . . . 

(A,,b,) 

I 

1 

(AiBj) 

(A^B,) 1 ... 

j 1 

{ApB^) 

1 

j (B,) 

— ( 
t 
! 

i 

. . . 


. . . 

1 ... (13.27) 


1 I ‘ ~ I 

Bq j {AxBq) 1 {AJBq) ^ ... ’ {ApB(j) I (Bq) 

, I I I 1 

1 ““ 1 - I - I ~ - 

I M.) , ■ ! (A,) 

1 ' I . 


Totals 


N 
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This is known ^ a contingency table. We have already encountered an example in 
Table 12.4. Ordinary bivariate frequency tables can, of course, be regarded as contingency 
tables, but there is a difference: in the bivariate table the order of rows and columns is 
determined by the variate-values, whereas in the contingency table the order of rows and 
columns is, in general, arbitrary. 

In (13.27) the frequency in the ith column and jth row is denoted by As 

in the case of the 2x2 table we write 

6,; = .(13.28) 


and define the attributes as independent if every d is zero. We have: 


Iv 


N - - 0 

and, in conformity with the notation of (12.6) we have 


(13.29) 




(13.30) 


is sometimes called the square contingency and 


^ the mean square contingency. 


13.13. We have already seen in Chapter 12 how he used to test the hypo¬ 

thesis that the observed frequencies could have arisen by random sampling from a popu¬ 
lation in which the attributes were independent. We now proceed to consider the con¬ 
struction of measures of dependence. 

Evidently ^ q if only if each <5=0. Thus x^ vanishes if and only if the 

attributes are independent in the observed population. Furthermore, as becomes 
larger the observed frequencies deviate more and more from the ‘‘ independence ’’ fre¬ 
quencies ; it thus provides some sort of measure of the strength of relationship in con¬ 
tingency tables. For example, in the 2x2 table we have 

F(equation (13.16)) = . . (13,31) 

which illustrates the relationship between and x^- 

X^ itself, however, does not constitute a very useful coefficient since it may increase 
without limit. Following Karl Pearson we may put 

. 

and call G Pearson’s coefficient of contingency. Even this has its limitations. It vanishes, 
as it should, when there is complete independence ; but in general it cannot attain unity. 
Consider, for example, a f x / table in which the diagonals {A^B^) are of frequency oq and 
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aji other compartments are zero. 
We then have 


Obviously no greater degree of dependence is p<waiMe. 



and 



= (N - 1)< 

C = .(13.33) 


If / = 5, for example, the maximum value of C is 0.894. 

To remedy this effect Tsehuprow proposed the coefficient 

T = / ^ ^ y.(13.34) 

lNV(i> - 1)(^ - 1)/ 

This can attain unity when p ^ q ; but it is still not clear how it behaves when p and 
q are unequal. 


Example 13M 

TABLE 13.1 


Distribution of Schoolchildren according to hitelligence and Standard of Chthing. 
(Prom W. H. Gilby (1911), Biometrika, 8, 94 ) 



A and B 


D 

E 

F 

G 

Totals. 

Very well clad . 

33 

48 

113 

209 

194 

39 

636 

Well clad .... 

41 

100 

202 

265 

138 

15 

751 

Poor but passable . 

39 

58 

70 1 

1 

i 61 

1 : 

33 

1 4 

265 

Very badly clad 


13 

22 

10 

10 

1 

73 

Totals 

130 

219 

^ 407 

535 

i 

376 

59 

1725 


The above table shows the distribution of 1725 schoolchildren who were classified 
(1) according to their standard of clothing and (2) according to their inte>lligence, the 
standards in the latter case being A = mentally deficient, B — slow and dull, C = dull, 
D ^ slow but intelligent, E ^ fairly intelligent, F = distinctly capable, O = very able. 
Required to discuss whether there is any association between standards of clothing and 
intelligence. 

We note in the first place that a table of this kind could, theoretically, be discussed 
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Ijy oonsidetiitig all the possible 2x2 oompaiisons to be extracted from it; e.g, for the 
ootnera of the table we have 



' 

A and 

. 0 

Totals. ! 

Very well clad 

33 

39 

! 

72 1 

Very badly clad ... 

1 17 

1 1 

1 ^ 1 

18 

i Totals 

i 

50 

1 

40 

1 ! 

1 

90 ' 

1 


Here, for example, 54 per cent, of the very well clad were very able, but only 5 per cent, 
of the very badly clad. However, what we really require is not a series of individual 
comparisons of this kind but a general comparison over the whole table, and it is for such 
purposes that the coefficient of contingency is designed. 

We then proceed to work out the ‘‘ independence ” frequencies, e.g. that in the top 

left-hand corner of the table is —= 47*930. The contribution to from this 

( 14 - 930)2 

compartment is then ^ ^^.930 ^ ^*^^1- It will be found that the sum of the contributions 

from the 20 compartments is 174*92. We then have 

♦92 


v 1725 + j 
of asso( 

\/ i725i/l5 


- 0*303, 


174*92 

indicating a considerable degree of association. For the Tschuprow coefficient we have 


There is evidently some general relationship between the two attributes, though not 
a very strong one. The reader may verify for himself by using the test that the values 
of C and T are significant, i.e. could not have arisen by sampling from independent attributes. 


13.14. The sampling variance of the coefficient of contingency is difficult to arrive 
at in virtue of sheer algebraical complexity ; and it is not clear how far the use of a standard 
error is legitimate in this connection. Reference may be made for the formulae to K. Pearson 
(1915a) and Kondo (1929). For the even more’"complicated question of partial contingency 
see K. Pearson (19156). 


13.15. In concluding this chapter we point out that all the measures of association 
and contingency discussed therein in no way rely on the possibility of the measurement 
of attributes on a variate**scale, or even on the possibility of arranging them in order. 
Rearrangement of rows and columns in the two-way tables does not affect the values of 
the coefficients.* In the next chapter we shall consider the relationship between variates 

* Kxcopt that it may change the sign of a coofficiont of association. Tliis is equivalent to a slight 
change of standpoint in what is re*gai’ded as a positive association—for example, positive association 
between fair hair and blue eyes is equivalent to negative association between fair hair and not-blue eyes. 
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and certain coefficients based on the assumption that the attribute classifications are 
made according to the divisions of a variate-scale. These coefficients (tetrachoric r, bisorial 
rj, etc.) have been used as measures of association, but they are essentially different in 
character from those discussed in this chapter. The reader who refers to memoirs written 
on this subject between 1900 and 1920 will find it useful to remember this fact. 
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EXERCISES 

13.1. Show that the coefficient of association is greater in absolute value than the 
coefficient of colligation, except when both are zero or unity. 

13.2. Show that for a contingency table with a constant number of rows and columns 
the Pearson coefficient of contingency C is equal to the 7''8cbuprow coefficient T for tvo 

y2 

values of one of which is zero ; that for between these values C > T, and for 
^eater than the higher value T ^ C. 
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133., The following table shows 6S lobelia plants classified according to whether they 
were cross- or self-fertilised and above or below average height. 



j Above Average, 

Below Avei'ago. 1 

Totals. 

Cross-fertilised 

17 

1 

— 1 
! 

17 

1 

34 

Self-fertilised . 

1 

. . , 1 12 

22 

1 

34 


Totai.s ‘ 29 

39 ' 

08 


8 I 10 W that Y -^0*150 and that this is not significant of association if these data are 
a random sami)le from lobelia plants generally. 


13.4. Tn the hair and eye-colour of Table 12.4 show that C *= 0*37 and T = 0*25. 

13.5. Tn a pajier discnissing whether laterality of hand is associated with laterality 
of eye (measured by astigmatism, acuity of vision, etc.) T. L. Woo obtained the following 
results {Biometrika, 20a, pp. 79-148) — 

Ocular Laterality foi Ooncial Astigmatism. 


Ill 

^ bci 
r {3 t 






i 


P* £ 


J..C‘ft haiulcd 

Ambidextrous 

Hight-banded 

T<)TaI-.s 


“ Lf‘n: eved.” 


34 


1 IH 


Ambiocuiai. 

62 

28 

105 

195 


1 

‘ Kigbt ny»*d. ’ Totals. | 


28 

124 

20 

75 

52 

214 

100 

413 


Show that laterality of (\ye is only slightly associated witli laterality of hand, and that 
the association is not significant; 
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PRODUCT-MOMENT CORRELATION 


14.1. At the end of Chapter 1 there were given a few examples of bivariate frequency 
tables. We now proceed to consider such tables in greater detail and to discuss methods 
of measuring the dependence of the two variates represented in them. It is, of course^ 
possible to treat the problem by the methods of the previous chapter and regard the tables 
as contingency tables ; but when data are classified according to a numerical variable more 
exact methods are available in an important class of cases. 

The types of bivariate distribution arising in practice are not so easy to classify as the 
univariate types. Table 1.15 on page 20, showing the distribuiion of beans according to 
length and breadth, and Table 1.25 on page 27 showing the number of cows according to 
age and milk yield, evidently correspond more or less to the unimodal univariate distribution, 
for not only the border frequencies but the frequencies in individual rows and columns are 
of the unimodal type. Biometric distributions are often of this character. On the other 
hand, Table 1.26 on page 28, showing discount rates and bank reserves, has the border 
column of the unimodal type and the border row of the J-shaped type. In Tables 14 1 to 
14.3 are given three more examples of the kind of material encountered in practice. 
Table 14,1 shows the distribution of a number of persons according to age and highest 
audible pitch ; Table 14.2 the distribution of registration districts according to proportion 
of male births and total number of births , and Table 14.3 shows the distribution of sons 
according to stature of son and stature of father. 
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TABLE 14 1 

Distribution of 3379 Persons according to Age and Higher Audible Pitch 
(From Y. Koga and G M Morant, Btomebrika, 15, 346.) 

The numbers in brackets are explamed in Example 14.1, p. 331. 

\ge vears 


} 
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TABLE 14.2 

Showing the Number of Registration Districts in England and Wales exhibiting (1) a ginm 
Pro 2 >ortion of Male Births, (2) a given Total Number of Births during the Decade 1881-^90, 
(The Data as to Total Births and Numbers of Male and Female Births from Decennial 
Supplement to Report of the Registrar-OeneraL Table from H. D. Vigor and G. U. Yule, 
Jour. Roy. Stat. Soc., 69» 1906.) 
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— 
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— 1 

— 

1 
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J 

1 
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14.2. In accordance with the definitions of the previous cliapter we may say that 
two variables are independent in a bivariate table if the observed frequency in the jth 

row and ^th column {A^Bj), is equal to fn such a ease, for any two rows J and k 


the frequencies will be proportional to {A^)(B^) and (Ai)(Bj^) ; so that the distribution in 
any row is similar and similarly situated to that in any other row. It will, for example, 
have the same mean and variance. Similarly for the columns. 

The measures of dependence we shall consider are related to the extent to which row 
and column means and variances differ among themselves. If the variates are independent 
all row means and all column means are equal. The converse is not true in general, but 
becomes so in an important special case when the distribution is normal. 
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TABLE 14.3 

DiHribution of 1078 Sons according to (1) Stature of Father and (2) Stature of Son : One 

or Two Sons only of each Father, 

(From Karl Pearson and Alice Lee, Biometrika, 2 (1903), 415.) 

Measurements in inches. Note that where a height falls on the border-line of an interval, 
one-half of the individual is assigned to each contiguous interval. 
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Regression 

14.3. The rows and columns will be referred to by the general term “ arrays *’ and 
we shall consider tlie two variates x and y, x being taken to vary horizontally, i.e. in rows, 
and y vertically, i.e. in columns. Consider then the means of arrays. Take two axes 
OX and OY at right angles representing the variates x and y. On this frame of reference 
plot the points whose abscissae ate the centres of the x-intervals and whose ordinates are 
the means of the corresponding distributions of y in the columns centred at the appropriate 
a V. Similarly, plot the means of the .r-distributions against the centres of the corres- 
ponduig ^/-intervals. (In practice it is useful to distinguish the two, the means of .r’s being 
denoted by small circles and those of y's by crosses.) Fig. 14.1 shows such a diagram 
for the data of Table 14.3 and Fig. 14.2 for the data of Table 14.2. 

The means of arrays will in general lie more or less closely round smooth curves. For 
example, in Fig. 14.1 they lie approximately on straight lines, whereas in Fig. 14.2 one set of 
means certainly does not. Such curves are called regression curves and their equations with 
respect to OX and OY are called regression equations. If the lines are straight the regression 
is said to be linear ; if not, curvilinear or skew. 

To put these geometrically expressed ideas in analytical language, suppose the mean 







Son's Stature 


! ‘ 


828 PfeODUCT-MOMENT COREBLATION 


( 

of X in the array centred at is Jj. Then the points {§i, may bo represented by a fimo* 
tional equation— 

*=/(y).(14.1) 

which is the regression equation of x on y. If the regression is linear, 

X — ^y + X. 

There will also be an equation 


9 = gix). 


(14.2) 


the regression of y on a:. 


Fathers Stature (inches) 



Fia, 14.1 —Kogi’OfesioTi Linen ol Data of Table 14 3 
Means of rows shown by rirclos, and ooiresponding 
regression imo by HR , means oi columns shown by 
Crosses, and coriespondmg regression hue by CC 


Proffortton of Male Births f^r 1000births. 



Fig 14 2 —liegiossion Lints of Data of Table 14 2 
Means of rows shown by einles, and (onesponding 
regression lino by HR ; means of columns shown by 
trossos, and iegression luxe ])y 


In this chapter we shall mainly be concerned with the case in which regresvsions are 
linear or very nearly so. 

14.4. In an observed distribution the means of arrays will not as a rule lie exactly 
on straight lines, or indeed on any simple curves, although they may be very near to doing 
so. The question then arises : if the regression is approximately linear, what is the best 
line to take as the regression line ^ The question may be answered by an appeal to the 
method of least squares. The regression of x on y, say x ^ ^y oty will be determined by 
minimising the sum 


U = £Ni{Xi — Py^ — a)*, 


(14.3) 
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^ AtmiBAiion lexiemdiitg over all ^-intervals. Hwe lepieaents the frequency in the 
tit tow, and we note that £(Nt is equal to the total frequency N times the mean of x for 
the whole distcU)utaon. 

From (14.3) we have, for the minimal valqes of a and /?, 

dU 

— = 2i:Ni(Xi - /Jy< — a) 0 . . . , (14.4) 

^ 2I:N^y^(Xi ~ Pyt - a) 0 .... ( 14 .^) 

Now choose the origin at the.means of x and y fox the distribution. Then = 0 

and ZN^y^ = 0 and hence, from (14.4) 

a = 0 . 

From (14.6) we then have 

i:(N,y,x,)-pZ(N,y,*)^0. 

Now since the origin has been chosen at the mean of * and y, Z{N^ y, x,) — N cov (x, y) 
and ir(jV^ y,®) — N var y. Hence we have 




cov (x, y) 
var y 


(14.6) 


The equation of the regression of x on y, taking X and T to be current co-ordinates, 
will then be 

. 

var y ' ' 

Referred to an arbitrary origin for which the means of x, y are x, y, the equation is 

cov (x, y) 


(X - X) 


var y 




Similarly we find for the regression of y on x 

(y - y) - <*■ - 1) . 

var X 


(14.8) 


(14.9) 


Equations (14.8) and (14.9) are fundamental. If the regressions are exactly linear they 
give the regression equations ; if not, they give the best ” straight regression lines in the 
sense of the method of least squares. 


The Coefficient of Product-moment Correlaticni 

oov (x t/) cov (x u) 

14.5* The coefficients - ’ and ’ are called regression coefficients and 

vat y YdiTx ^ 

will be denoted by and fit respectively.’*' 

We now define 

p = 

_ cov {x, y) 

(var X var y)^' 


(14.10) 


* There is little danger of confusion between this notation and the use of y?, to indicate 
measures of skewness and kurtosis. The two rarely occur in the same context. 
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p is called the coefficient of product-moment correlation or briefly the correlation coefficient. 
It provides an important measure of the relation between two variates for which the 
regressions are approximately linear. In this expression the square root is to have positive 
sign. 

Let us note in the first place that p cannot be greater than unity in absolute value. 
For we have, taking an origin at the means and summing for aU pairs of values of a;, y over 
the population, 

E(x — = Six^) — 2pi2:{xy) + 

= 2’(a:*){l 

= 2>*)(l-p*).(14.11) 

Thus 1 — p® cannot be negative. 

Furthermore, if p == db 1» = 0 and hence every x -r- /9ty = 0. Thus the 

variates are linearly related by the equation X — /9iT = 0. If p = 0 the regression 
equations become X — 0, F == 0, for then cov (r, y) ~ 0, Hence the means of arrays are 
the same for all arrays. 


14.6. If p - -f 1 we say that the variates are perfectly positively correlated ; if 
0 <p < 1, that they are positively correlated ; if p = 0, that they are uncorrclated ; if 
0 > p > — 1, that they arc negatively correlated ; and if p ~ ™ 1, that they are perfectly 
negatively correlated. 

‘‘Uncorrelated ’’ is not the same thing as “ independent.'' If the variates are inde¬ 
pendent they are uncorrelated, but not vice-vert9a. Table 14.2 and Fig. 14.2 illustrate this 
point. The regression linos, as shown in the figure, are close to X — 0, F = 0 and the 
correlation is, in fact, very small ( — 0 014). But the variates are obviously far from 
indej>endence and if the data are grouped, in columns up to 404-5, by single columns up 
to 521-5, and over 521-5, and by rows 8-11, 12-13, 14-15, 16-17, 18-19, 20-21, 22-23, 
24-25, 26-27, 28 and over, the coefficient of contingency is 0*47. 


14.7. The calculation of the correlation coefficient in numerical examples requires 
that of the means and variances of the two variates and their covariance. The last is the 
only new tyi)e appearing, the others being calculable from border frequencies in the manner 
exemplified in (Chapter 3. 

Taking an arbitrary origin, we have, if the means of x and y are a and 6, 

N cov (.r, y) X{x - a){y — b) 

^ Z{xy) — (tZ{y) — bE{x) + Nab 
— 2J{xy) — Nab 

cov {x,y) = 2Xrv) —ab, . . . . (14.12) 

j\ 

Thus we may, as in the univariate case, take an arbitrary origin for arithmetical convenience, 
calculate the product sum 2^{xy) and determine the covariance by the use of (14.12). The 
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calculation of the product sum is exemplified below. As seen in 3.30, no Sheppard’s 
corrections are required for the first product moment. 


Example. 14.1 > 

To find the correlation coefficient and regression lines for the data of Table 14.1. 

We find the means and variances from the border columns in the usual way. 
An arbitrary mean is taken for x (age) at the centre of the interval 20-6 years and for 
t/ (higliest pitch) at the centre of the interval 1!) thousand vibration.s which may be taken 
as l!),yi).5. We find 


i:(a;) = 2,604, 
Eiy) = - 708, 
2’(a:2)=, 47,392, 
8894, 


/i'i(x) = 0-770,642 

jui(y) = — 0-209,529 
= 13-348,229 

= 2-604,904. 


To find the product sum 2’(xy) we require the product xp for each non-zero cell of the table. 
These products are shown in brackets in Table 14.1. Then we have, reading the table 
from left to right and from top to bottom, 


2>«/) =- (1 X 0) -h (1 X - 14) -f (1 X - 84) 

-h (1 X 18) + (1 y 12) + (3 y 6) -1 etc. 
-- - 12,.53r>, 


whence 


Thus 


cov (.T, y) 


- )2,.-)3r) 
3379 


(0 770.642)( -0 209,.529) 


-= - 3-548,205. 
cov ( X , I /) 


0-6136. 


a subhtautial negative correlation. The highest audible pitch decreases with increasing age. 
We also find 


cov (x, y) 
var y 


^2 ' 


COV {.i\ y) 
var X 


1-417 


0-2()58. 


The regression equations, for the units of the table and vitli our arbitrary means* are then 

X - 0 770() - - 1-417(1' + 0-2095) 

Y -I 0-2095 = ~ 0-2058(2" ™ 0-77(K)). 


Example. 14.2 

The following device is often useful in calculating product moments. We recall that 
2i:(,i7/) - + yY - 

== + ^y^) - - 2 /)^- 

Thus we may find E{xy) from either Z{x + yy or I!(x ~ and these quantities are often 
more convenient to calculate. 

For example, in the preceding example we note that x + y is constant down the 
diagonals running from the bottom right-hand to the top left-hand corner of the table. 
Taking x + y to he zero in the cell centred at a; = 20-5- and y — 19-, we may, in our 
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take it to be + 1 in the cell 23-5~, 1^, and -1 in 17*5-, 10-^, and so on. If we 
sum np the diagonals we get— 


X + y. 

Sum. 

X + y. 

Sum. 


1 

4 

124 

-~8 

1 

5 

112 

-7 

6 

6 

90 

-6 

11 

7 

69 

-5 

20 

8 

38 

-4 

93 

9 

23 

-.3 

, 207 

10 

21 

-2 

' 434 

11 

9 

-1 

594 

12 1 

9 

0 i 

1 637 

]3 1 

i 2 

1 i 

1 418 

14 1 

1 4 

2 

' 281 

15 1 

1 

3 j 

1 185 

1 



1 

Total i 

1 3379 


The total is 3379, which provides a check on the work. We then find the sum of squares 
in the ordinary way, obtaining 

£(x + y)^ = 31,216 = Z(x^) + i:(y^) + 2 Zixy). 

Then Z{xy) - |(31,216 - 47,392 - 8894) 

= — 12,535 as before. 

The rest of the calculation follows the same lines as in Example 14.1 

We should have obtained the same result for I^iry) if we had summed up the other 
diagonal. Which diagonal is chosen depends on how the frequencies lie in the table 


Example 14.3 


In the foregoing the regression lines and the correlation coefficient were arrived at 
from a consideration of grouped frequencies in a bivariate table We may, however, apply 
the same ideas to ungrouped material. There are no longer means of arrays, but the 
regression lines are still to be interpreted as the lines of best fit to the N pairs of vanate- 
values and the correlation coefficient as a measure of relationsliip between variates. 

Table 14.4 shows the yields of wheat and potatoes m 48 counties of England in 1936. 
In this particular case it is hardly worth while taking an arbitrary origin other than that 
given. We find (x = wheat, y - potatoes) 


Eix) -- 758 0, 
E{y) = 29M, 
E(x^) = 12,170*48, 
£{yi) = 1791*03, 
Z(xy) ^ 4612*64, 


yiix) ^ 15 791,667 
Piiy) = 6*064,583 
/LI 2 M ==- 4*174,930 
/Hiy) ^ 0-533,958 
y) = 0-326,888 


_ 0 326,888 

^ “ V(4-174,930 X 
= 0-2189, 

/?, = 0-6122, 

« 0-07830 
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TABLE 14.4 


Yields of Wheat and Potatoes m 48 Counties in England in 1936. 



Wheat 

Potatoes 


Wheat 

Potatoes 

County, 

(CWtfl. 

per aero). 

(tons 
per acre). 

County, 

(cwts. 
per acre). 

(tons 
|>er acre). 

Bedfordshire .... 

16 0 

63 

Northamptonshire . 

14 3 

4-9 

Huntingdonshire 

16 0 

6-6 

Peterborough .... 

■ 14 4 

6*6 

Cambndgeslure .... 

16 4 

6 1 

Buckinghamshire . 

15 2 

64 

Ely. 

20 6 

66 

Oxfordshire. 

14 1 

6 9 

Suifolk, West .... 

18 2 

6 9 

Warwickshire .... 

16 4 

5 6 

Suffolk, East 

16 3 

61 

Shropshire ... 

16 5 

6 1 

Essex. 

177 

6 4 

Worcestershire .... 

14-2 

6 7 

Hertfordsliire .... 

16 3 

63 

Gloucestershire .... 

13 2 

50 

Middlesex . ... 

16 5 

7-8 

Wiltshire. 

13 8 

6 5 

Norfolk 

16 0 

8-3 
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14 4 

6 2 

Lines. (Holland) 

! 21 8 

5-7 
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’ 16 5 
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[ 4 8 
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5 8 

Sussex, East i 

15 7 

4 9 
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6 5 
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6 5 

17 5 

5 8 
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12 8 ‘ 

6 7 
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15 8 
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12 0 1 

6 5 
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7 2 
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17 7 
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15 8 I 
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1 16 2 1 
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The regression lines are 

X - 15-792 = 0-6122 (7 -- 6-065) 

7 --- 6-065 = 0-0783 (X - 15-792) 

The data are shown in a graphical form in Fig. 14.3. Corresponding to each pair of 
values {x, y) there is plotted a point with those values as abscissa and ordinate. The 
totality of points furnishes what is known, for obvious reasons, as a scatter diagram. The 
two regression lines are also shown. 


The Bivariate Norfnal Distribution 


14.8. The distribution 
1 


dF 


2na,a^{l -- 


exp 


2(1 


1 ^ rf, .(14.13) 

- p~)\oi OiO^ aijj 


has already arisen (5.24) as the natural extension to two variates of the univariate normal 
distribution. In writing p in (14.13) we have anticipated a result which w ill now be proved, 
namely that p in that equation is in fact the correlation coefficient of the distribution. 
The characteristic function of (14.13) is 

<f)(ty n) =“ exp [— + 2utpaia^ +*^^ 2 ] 

wffience var x aj, var y 0 % 

cov (.T, y) ^ paiGz 

and the correlation coefficient is — P, as stated. 

Vi^m) 


The exponent in (14,13) may be written 


1 

2(1'-P^) 

I 

.2 


\0-i orj 

(d 

\<y^ a,) 


.^2 


(14.14) 

(14.15) 


2(1 -~p 

Thus for any fixed y, x is distributed normally about a mean given by 

and hence the means of the a:-arrayB of infinite thinness lie on the line 

X _p7 

0*1 (Jg 

and this is the regression of x on y. Similarly the means of ^/-arrays lie on 

7 ^pX 

Gy" ' 

the regression of y on x. Thus the regresvsion lines of the bivariate normal surface are 
exactly linear. 

Furthermore, from (14.14) it is seen that the variance of an array of x for fixed y is 

^?(i - 

i.e. is independent of y. Similarly the variance of an array of y is 

ai(l - p^) 


(14.16) 


(14.17) 


and is independent of x. 
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Thud the vd^Tiadioe of a;-ari*ays is the same for all arrayd ; and so for y. Distributions 
for which this is true are called homoscedastic. 

If /> 5= 0 the distribution becomes the product of two normal distributions and the 
variates are independent. Thus two uncorrelat^d rbormal variates are independent. 


14.9. A criterion for linearity of regression for the general bivariate surface may 
be obtained in terms of moments or oumulants. Taking an origin at the means of the two 
variates we have, if the regression of x on y is linear, 

X == 

or, if f{x, y) is the frequency function, 

f o) ^30 

y) = hy i /(^> y)^i^- 


Multiplying both sides by and integrating over the range of we have 



y^ y) dx dy ~ P 



00 


— 00 


y^'^^ f{x, y) dx dy 


or ^hp ^ (14.18) 

Tn particular fin = fi^^^ 

that iHviyup ^ ( 14 . 19 ) 

a condition on the central moments. Recalling the definition of bivariate cumulants 




i\ j\ ) 


we see that the univariate mean moments are related to cumulants in the same way as 
moments //j to cumulants /c, ^ and hence we also have 

p ~ fii ^ 0 ,/>+! ..... (14.20) 

^^02 f<i,p ==- .(14.21) 

Similarly, if the regression of y on x is linear we shall have 


^20 yp, 1 yii yp f 1 . <> \ 


(14.22) 


Under certain conditions these equations are sufficient for linearity of regression. For 
instance, if (14.18) is true for all p, then 


(■-•"■ir 


{x — pyy) fix, y) dx \ ^ 0. 


The expression in curly brackets is thus a function, not necessarily positive, whose moments 
vanish, and under certain general conditions this implies that the function itself vanishes, 
i.e. that 

(x - Pyy) fix, y) dx ^0 

or p,y, 

so that the regression of x on y is linear. 
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Example 14.4 (from Wicksell, Biometrika, 25, 126) 

Consider the bivariate distribution of the squares of variates «, y which are distribute^, 
in the bivariate normal form. The characteristic function of these variates is propot* 
tional to 



e«x* exp 


1 fx» 

2(1 W 


4- 

(TiO^ 



f-j: 


exp 


2(1 


^*{1 - 2a?(i - p-)it} - 

0 ’ i <T 2 


+ ^ (1 - 2a|(l - 


iv }J dx dy. 


This is proportional to (compare Exercise 1.5) 

__ 1 

I r 


.{1 ~ 2€r?(l -p^)it) 


OxOz 


1 


OlCf^ 


1 

^2 


{1 - 2al(Y ~ p^)inY 


which, except for constants, reduces to 

{(1 — 2crji^)(l — 2a\in) — . 

This is the characteristic function, for when t u ^ Q it reduces to umty. 

Now the frequency-distribution represented by this function is evidently not normal ; 
but its regressions ar‘e linear, for we have, taking logarithms. 

=- I log {(I - 2a,H)(l - 2al2n) - } 


r (ttniu) 


givmg, on identifying coefficients, 


and hence 


- ii2> “ 

K, , ^ 2p^aia\{2air 

Kix - 2p^ajai. 


^20 1 ) 1 0- 


Sampling of Regressio7i and CorrelaUcni Coefficients 

14«10. We now turn to consider the sampling problems associated with the coefficients 
of correlation and regression. 

First of all, as to standard errors. In Example 9.6 on page 211 we have anticipated 
the determination of the sampling variance of the correlation coefficient itself, obtaining 
the result for the normal case 

var r = - p2)2.(14.23) 

n 

Here, as usual, the Roman r is written for the value of p in the sample and n is the number 
in the sample. The result of (14.23) is not of great value, since the distribution of r tends 
to normality very slowly if p is not close to zero. It is probably as well not to use (14.23) 
unless n is greater than 500. 
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In the manner of Chapter 9 we have 


giving 


6. = 

mao 

^2 m^j mao 

var 62 _ var mn ^ var m^o _ 2 cov (mii, mao) 
hi mlQ miimao 


. (14.24) 


Substituting from (9.] 6) and (9.17), and writing the sampling values m instead of the parent 
/i^s, we have 


var bo 



4- - 

2W5i 

n 

»«lo 

m^imao, 


. (14.25) 


or, for the normal case, on using the values of Example 3.15, 


\ 

T 

1 


Similarly 


var feg 


5|/1 - r2\ 
n\ ) 


= 1 Y^I/n _ 
n var x 


var 6i 


1 var X 
n var y 


(1 


r®). 


. (14.26) 
. (14.27) 


To our order of approximation it is indifferent whether we write 1 —r® or 1 — 
on the right-hand side of these equations. 


Example 14.5 ^ 

In the data of Table 14.3 (height of fathers and height of sons) we find r + 0*51, 
for 71 ~ 1078. From inspceiion of the table wo see that the distribution is reasonably 
close to the normal type, and in this case /? is large enough to justify the use of the standard 
eiTor. We have then 


var r 


_ {1 ™ (0-51)2}^ 

1078 
== 0-000,508. 


Thus th(^ standard error is about 0-023. The correlation is thus undoubtedly significant, 
if the data were obtained by random sampling. It is improbable that the parent corre¬ 
lation p lies outside the range 0-51 i 0-05, and very improbable that it lies outside the 
range 0-51 ± 0*075. 


Eslhnates of Correiatio7h and Regression Coefficients in Normal Samples 

14.11. In large-sample theory the sample values of the correlation and regression 
coefficients may be taken as estimates of the population values in the usual way. They 
can also be used in small-sample theory and it may, in fact, bo shown that they are estimates 
giving maximum likelihood to samples from a bivariate normal population. 

A.S. 


z 
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The joint probability of n sample values (xi, pi) . . . {x„, y„) firom a bivariate normal 
population with means mi and m, is 


(IF =. - 


Iri "[~ 20 - p *){^( V^')’ “ 


(2;T)»^o'i»‘ffj’*(l - p^yi 


{X — mi)(y — m.) 


+ ^ IJdxi Jpi . . . dx^ dy^ (14,28) 

The likelihood function may then be written 

L oc ^ exp r~ , \ -- 2pR -f 6’}1 

Ofi"(T/‘{l — p^)i I- -( P > J 

and thus, for the maximisation of log L we have 


(14.29) 


1 

L dm I 


2(1 


^ 2\{“- »«i) + 

- P^){ ai 


(Tx(T 2 


giving 


l\x — -- ^ - nf^) — 0 

O'! <T2 


Similarly from } - 0 we have 

Jj dtti 2 


^ E{x — Wi) — ^ E(y - m^) -- 0 

<Tl <72 

Thus from (14 30) and (14.31), p not being unity in general, 

E(x — mi) ~ E(y m^) -- 0 

nil — ^ 27(u’) 

H 

m,_ — Ij Z(y) 

SO that our estimate^s of the means are the meann of the sample. 
We also find, equating log 1 

d(Ti 

in Uj, 02 and (1 —- p“) respectively, 


(14..30) 


(14.;{]) 


(14 32) 


d B B 

We also find, equating log L, log L and log L to zero and cancelling factors 

v(7i ^^2 


n H- 


1 

1 — p 
1 

1 - p^ 

{A-- 2 pB-^-C} “^^ = 0 

1 - p 


{A - pB) - 0 
( — pB + (?) — 0 


. (11.33) 


whence 


B 

71 

A 

n n 


1 
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giving foe tAie estuuates of <rf, <4 a-nd p 

a? = -Z(a; — «ii)* 
n 

of = -£(y — ffij)® 

^ Six — mi)(y — mg) 

^ {Six — mi)^ ~ ma)2}i 


(14.a4) 


which, on substituting the estimates of mj and given by (14.32), become the saniple 
variances and correlation coefficient. 


Distribution of Sample Means, Variances and Covariance in Normal Samples 

14.12* In accordance with the result of the previous section we will take our estimates 
of the parameters mj, a\ and p to bo the corresponding sample values x, y, sf, s| 

and r. The joint distribution of the sample values is given by (14.28) and it is remarkable 
that the exponent in that expression can be expressed solely in terms of the five parameters 
and their estimates. We have, in fact, 



(TiC 2 



2 


- s 


(X ^ X 


miV 


rrr 


+ two similar terms 


_ ^(.r xY -f four similar terms, 

uf a\ 

the product terms vanisliing becatise Six — x) =- Siy — ^) = 0, 

^ r + fwo similar terms 

i j 

(i= - w,)2 _ (x — mi)( y — m^) (y 


Zp - 

4_ viL»- + f . 

[af fT,<72 cr|J 


“ ^^ 2)^1 

or| / 


(14.35) 


We proceed to find the joint distribution of the five statistics, and to do so require 
to express the frequency eknnent (14,28) in terms of them. The non-differential part of 
that element is given by the exponential of (14.35). It remains to express in the requisite 
form the volume element dxi . . . dx^^ dyi . . . dy^^ 

Generalising the geometrical approach of Chapter 10, we may imagine a sample space 
of 2n dimensions, n for x and n for y. The sample point may vary in the x-space and the 
t^-space, but not independently so. In fact, if F represents the point (u^i . . . x^) in the 
.r-space and Q the point («/i . . . y^) in the ^/-space, and if Oi, 0^ are the points ix , . . x), 
{y * * • y)y then for any given r we have 


r ==: ^)iy — y) ^ — x)(i/ — y) 

nsis^ [Six - x)^Siy — y)^}^ 

and thus r is the cosine of the angle, say 0, between FOi and QO^, so that if P and r are 
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fixed Q varies on the cone in the y-spao© obtained by rotating OjQ such that the angle 
made with OxP is constant. 

The element in the x-space is proportional to dsx dxi as was seen in Example 10.5. 
For given r, y and the point Q varies on the zone of the hyperspher© of radius 
centre y and {ri 1) dimensions. This zone has radius s^Vn (1 — r®)* and 

a \/ih dv 

width s^\/n dO — and thus its content is proportional to 




(1 


n I 

r2) 2 , 


(1 _ *■»" 

Thus the volume element may be written 

dv QC dsi dx “ d .<?2 dy (1 


71 

r^) dr 


oc ^ dSx ds^ (1 


7t -4 

r“) ^ dr dx dy 


(14.36) 


and the joint frequency element of the five variables is then proportional to 


exp 


n 


2(1 ~ p^) 






ni, )(y 

(Ti (72 


Wj ) (y 




) I '^*^1 O 1*^*2 

“i ?u — 2pr 

[ai 0x02 


dv (14.37) 


This fundamental result is due to R. A. Fisher (1915). 


14.13. One important proi)erty of (14.37) may be remarked. The distribution may 
be factorLsed into two parts, one containing only Jr and y and the other only lSj, 6*2 and r, 
namely (except for constants) 


(IF oc exp 



V r(r - m,Y _2 ~ 





(14.38) 


and 

dF oc exp 



2pr6i6o 

"HI 


0x02 

-i/J 


2(1 -- r2) r/ 6 , f /62 dr . (14.39) 


Thus we see that in normal samples the distribution of means is entirely independent of 
that of variances and covariance. 

Before leaving (14.38) we may also note that the means are themselves distributed 

(T (T^ 

in the bivariate normal form, with mean (x) — m,, mean [y) = Wj, var {x) — K varr(y) =. 
(all of which results are already familiar), and 


cov(i^, .V) .(14.40) 

7f 

BO that the coirelation between x and y is p, the correlation in the parent population. 


14.14. We may now use (14.37) to obtain the distribution of the correlation co¬ 
efficient, namely, by integrating wdih respect to 6 i and 62 from 0 to 00 . Let us first of all 

evaluate the constant to be attaclied to it from the consideration that [dF = 1. 
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Make the variate transformation 


of 2(1 - p>) 

. _ rsiSi ' n 

_ n 

We have for the Jacobian of the transformation 

_ 0 ») 

of 2(1 - p») 

d{a, b, c) _ rsj, n SiS^ rsi w 

3(«i, »•, «j) ~ o,ai2{\-p^) criCT/2(l — p^) aiO^'’2(1 — p^) 

I - a^-2(l-p^) 

__ .vfcs*| _ 2acn 


2alalil — p2)» - p2) 


(14.41) 


and also the relation 


The integral then becomes 


jexpL - » + 2^ 


X (l - da db dc 

\ ac) 2acn 


^n~\ _ ^2).! 


exp[— f? + 2ph —' r] (ac — 6^) 2 t/a r/6 rfc . (14.42) 


where the limits of a and c are 0 to 00 and those of b are — 00 to -f 00 . This integral may 
be evaluated in terms of the jT-function. Putting f = a — ^ we find 

r / b^\ ^ -i 

I exp (— exp / 4- 2pb — c — ^ 2 r 2 r7| dl dc 

^ 2 0 1 c ~ + (^ — fZr 

= j exp{- (1 - p*)f }r 2 rfc 


« 1 

C 2 rfc 




i'l 


71 1 

(1 - p^) 2 - 


71 r(« -^) 

n- 1 

2«-3(1 — p2) “2“ 


. (14.43) 
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Collecting up the terms from (14.42) and (14.43) we find for the joint distribution of Sj, 
a, and r 

dF ~ - 


n —1 


(1 — 2 r{n — 2 ) 

Now put 


2(l-p*)Vf 0x0, 


« — 4 


r^) 2 ddi dsi dr (14.44) 




0’i<X2 


log'^A r 


We find, for the Jacobian of the translormation 


d(C.z,r) 

9(«i, «ii. >■) 1 


O'jCTj 

1 _ 1 

I Sj S2 

1 0 0 

2 

(T 1 G 2 


0 

1 


The exponent in (14.44) becomes 

[“ 2(1 - ~ ^ 
and after a little reduction the distribution becomes 


(IF = 


rtW-l 


f-- , - ^(cosh z — pr) w"'‘^</C <^2(1 — 

L (1 ~ P) J 


„_i - — ®^P 

7r(l-p*)”2 Fill -2) 

On integration with respect to C we have 

7tr(n — 2) (cosh 2 ; — 
Putting — pr — cos Q we have, since 


Jo 


dz _ 0 

cosh z f cos 0 sin 0 ' 


d( — cos 0)” “ \8in 6/ 


7tr{n - 2) 

n-1 

(1 


\dr 


(1 — p®) 2 ,, 2 " i d"-® /co8'"i(--pr)] , 

This is as simple a form as can be given in terms of elementary functions 
14.15. In the particular case p — 0, (14.4.5) reduces to 


(14.46) 


dF 




(1 —- r®) 2 dr 


. (14.46) 
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>, >' 




a form sumiised<l>y “ Student ” in 1908. This distribution provides a test of the hypothesis 
that an observed r arose from an uncorrelated normal population. Its distribution function 
may be obtained from incomplete JB-functions, or more conveniently by putting 

' - ri) . 

which transforms (14.46) to 
dF = 

v(« 

The integral of this function has been tabulated and is given as Appendix Table 3. 
Fisher and Yates have also tabulated some of the significanc e points of i and of r itself, 
i.e. the values of r (for various n) for wluch the distribution function takes specified values. 


dt 




(14.48) 


14.16. The general distribution (14 45) has been studied in some detail, but lack 
of space prevents the inclusion of the extensive analysis involved. We will here indicate 
only the more important features of the results 

First, as to the shape of the frequency curves. When rt = 2 the distribution becomes 


JT{1 - r^) V(1 - />V2) 


dr 


and the frequency curve may be written 

_ 0 
y y^ 0 


0 = cos~^(— pr). 


(14.49) 


For r — ih 1 the ordinate is infinite and the distribution will be found to be U-shaped. 
When = 3 wo find 


y =- ?/o 


/_L. 

\8in® e 


0 cos 0^ 1 

sin^Oj (1 - r2)F 


. (14.50) 


again a U-shaped distribution. For = 4, 


y = - 3cot0 + SOcot^e}.(14..51) 


If p =r 0 this reduces to the rectangular form y = In other cases the curve is J-shaped. 
increasing from a minimum at r == — 1 to a maximum (but not an infinite maximum) 
at T -j~ 1. 

For /i > 4 the frequency curves are unimodal and tend to normality with large 
though slowly. Some interesting photographs of models of these curves are given in the 
Co-operative Study” (1917). 


14.17. The moments of the distribution are expressible in terms of hypergeometric 
functions. Returning to (14.44) let us write 


af(l 




n 


<4 


g|(l - P*). 


n 



344 


PRODUCT-MOMENT CORRELATION 


After a little rearrangement the distribution becomes 


dF - exp 

7tr{n — 2) 


1 _ 1 ^ ^ 

2 af 2 a| aia^ 


ai/ \a8, 


\l - 


dr . . (14.52) 


Putting Ui === —, U 2 = and expanding the term in exp Ipr—- ) we have 

ai aj \ OLiOLi/ 

w—l n — 4 

dF = ®*p (- i"i ~ «,"-*(! - r*) ^ 

^ -fr 


dui (hi 2 (Ir . . (14.53) 

1 ^ ‘ 


Integrating for U 2 from 0 to 00 we find for the distribution of Ui and r 

dF = 2) dr r ^ ~ * 2“^". 

Multiplying by r and integrating from — 1 to + 1 we find 

and finally, integrating with respect to Ui we obtain 

^ ^r(n~2)-^ (2j-f 1)! V 2;^V2’ 2;"\,2;^ 

Substituting for the JS-function in terms of jT-functions and remembering that 


fi -f 2; — 2 


Fix) I\x -I- 1) = r{2x), 


we find 


71-1 

p(l — p*) .2 


^/n 1\ „/w 




p(i - p“) 2 r 




|».|m p2 |7i(j9? -f l).^»?(|7l + l)p< 

Un -f- 1) 2! \{v -f Y).i(?i 4- 3) 4! 


' P(|/t, ln,l(n + l),p=>) 


and since P(a, /?, y, x) = (1 — r)’’-”-'’ F{y — a, )> - fi, y, x) 




i\ .,/n + • 


. (14.65) 
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In a similar way it may be shown that 

= 1 - (1 - p*) F(l, 1, i(« + 1), p®) . . . (14.56) 

These series converge fairly rapidly for moderate or large n. 


14.18. The ordinates and distribution function of the correlation coefficient are not 
expressible in terms of simple mathematical functions. They have, however, been tabulated 
by David (1938) for values of n = 2(1)25, 50, 100, 200 and 400 ; for p = 0 0(0*l)0-9 ; and 
for r = — l-00{0 05) + 1-00, with finer intervals in places. 

For many practical purposes it is sufficient to use a transformation of the distribution 
due to Fisher (1921). Putting 


r = tanh z, 
p = tanh 


2 = i log 1 


. (14.57) 


we may expand the frequency function of r in powers oi s — C, = .r say, and inverse powers 
of n. Fisher gives the following expansion : 




^ +h^ + 




"r-. 4 


4 - p._ 4 t 

16(/^ ™ 1) 48 




4 -i- 12p2 + 9p« 8^ 2p^ -+ 3p* 

128(« - 1)* 64(% - 1) 


4 


8 -+ 4p2 




28 - ir)p* 

-^ x^{n — 1 ) 


) + 


-1)’ 


a:® 4 . . 


Taking moments about x - 0 we find, on transferring to the mean, 

1 + p^ 


/4 


P 

2{n ~~ 1) 


1 i ' ' ^ 1 

8(/^ - 1) 






/^3 


1 




n iV ^ 2(« - 1) ' 48(w — 1)2 

p{p^ “ -i’«) 

{ii - 1 )“ 

f 224 - 48p2 - ;ip« 14'^ - 228p2 ~ UlpO - Sp® 
{n - ^ - 1) ^ ~ •52(« - 1)® 


(14.68) 

(14.59) 

(14.60) 

(14.61) 

(14.62) 


The remarkable thing about the transformation is that the distribution of r, which is very 
skew, becomes the distribution of 2 — C, which is nearly symmetrical. In fact, 


ri -= 



(P® - h) 


ya 


32 - 3p* 

16(jt — 1) 


. (14.63) 


. (14.64) 
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Thus we may take « — C to be approximately normally distributed with maan a^d 
variance given by (14.59) and (14.60). As a slightly rougher approximation we may take 

P 


f^\{^ - C) 


2 (n - 1) 


(14.65) 


var (z — f) 

which is approximately equal for small p to 

1 


n 


1 2{n -- 1)2 


n — 1 ^ (n — 1)2 
—1— approximately 


(14.66) 


When n is moderate we may take a still rougher approximation by assuming 2 — f to be 

normally distributed about zero mean with variance ^-Some comparisons of the 

various approximations are given in the introduction to David’s tables, and it appears 
that for n > 50 the forms (14,65) and (14.66) are adequate. The approximation given 
by (14.59) and (14.60) appears to hold satisfactorily for values of n as low as 11. 


14.19, Except in the case of the normal parent very little exact knowledge is available 
about the sampling distribution of the correlation coefficient. There is, however, some 
empirical evidence to justify the use of the above results when the population does not 
differ very much from the normal. E. S. Pearson (1931), in dealing with some experi¬ 
mental results, concluded that “ the results suggest that the normal bivariate surface can be 
mutilated and distorted to a remarkable degree without affecting the frequency distribu¬ 
tion of r.’’ The subject does not seem to have been investigated mathematically except 
in special cases. 


Example 14 £ 


In Example 14.3 we obtained for the correlation coefficient between wheat and potatoes 
a value of 0*2182. Suppose we regard the 48 counties as giving a random sample of the 
yields of wheat and potatoes, either for a wider area or for an extended period of years. 
The question then is, can such a value have arisen by chance from a population in which 
the yields of wheat and potatoes are uncorrelatcd ? 

From prior knowledge of crop yields we can assume with some confidence approximate 
normality in the parent population. Let us then test the hypothesis that th^ correlation 
in this population is zero. 

We have 


z 


= I loge 


1 + r 
1 - r 


== Jlog, 


1-2189 

^811 


0-2225 


c = 0 


V(n - 3) " V(i5) 

The deviation 2 — C is thus 0-2225, or about 1-49 times the standard error. This is not 
very improbable and the observed correlation may thus be accidental. 
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Smmph 14.7 

In a sample of M a correlation coefficient is found to be + 0-5. What is the proba¬ 
bility that a value equal to or lees than this should have been obtained from a normal 
population in which the correlation is + 0-7 ? 

The exact value, from David’s table, is, to five decimal places, 0-01289. Let us first 
of all take the approximation which assumes z — C to be distributed about zero mean with 

variance ——jrr. We have 
{n ^ 3) 

2 = I log = 0-5493 

^ = 4 log L±_P = 0-8673 

‘ . 1 —p 

J__ = 0-1459, 3 - ^ - 0-3180. 

V(n - 3) 

The deviation is thus 2-18 times the standard error, and the required probability, from 
the table of the normal integral, 0*0140 approximately, compared with the true value 
of 0*0129. The approximate test is not quite stringent enough. 

Let us then take s — ^ to be distributed normally about mean ^ 1 ) 0-00714. 

The deviation is then — 0-3251, or 2*23 times the standard error, giving a probability of 
about 0-0129, almost the exact value. 


Example 14.8 

In a sample of there is observed a correlation of Ti and in a second sample of Hg 
a correlation of rg. Are the sample values Ti and rg compatible with the hjq)othe 8 i 3 that 
the samples arose from the same popiilation? 

Suppose the hypothesis were true, and that p is the correlation coefficient in the popula¬ 
tion. Then if = tanh~~^ ri, Sg = tanh“*^ rg, C tanh p, we know that if the population 

were normal, Zi — C will be distributed approximately with variance — ^ ^ and Z 2 — C 

7li — O 

with variance-^~* Thus the difference Zj — ^ (z^ — t) — {z^ — C) is distributed 

71 j — o 

approximately normally with variance 

7i j 3 w 2 3 

and this will provide a test of the hypothesis. 


DistribntioTi of Regression Coefficients in Normal Samples 

14.20. 

frequency-distribution of ,Si, and 62 

2ps\b2 


TS 

Turning again to equation (14.44) we have, substituting 62 = —, the joint 

^1 


dF oc exp 


[ 


2(1 - p») 


u 








a2A2\n~4 

dsids^dbi (14.67) 

tSg / 
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Integration with respect to «» gives for the distribution of Si and 6, 
dF oc exp f- - ** - 

A further integration with respect to Sx gives for the distribution of 6* 

dV rr 

\ ^2 / 


or, on evaluation of the constant, 


dF 


-p^) 


;(i -p^) \ 




(14.0B) 


The distribution of the regression coefficient bi is obtainable by interchanging the suffixes 
1 and 2. 

The form (14.68) is a Pearson Type VII distribution, symmetrical about the point 

== the population regression coefficient. It tends to normality fairly rapidly, and 

the use of the standard error for regressions is therefore valid for lower values of n than 
in the case of the correlation coefficient. For small samples, however, (14.68) not of 
much use since it depends on the unknown quantities Ou and p, i.e. the population variances 
and covariance. 


14.21. It is possible to find statistics other than bx and fcj which will provide a test 
of the regressions. Write 

. 

We now return to the distribution of the quantities a, 6, c of equation (14,41), namely, 


dF oc exp [ — a + 2pb — o] (ac ~ b^) 2 da db dc . 
We have from (14.09) 

_ b — pa 

and on substituting for c in (14,70) we have, after a little reduction, 


. (14.70) 


dF oc 


exp a^l -+ dadu 


.exp - paT-^db. 


The integral of the second part on the right for b will be found to give a factor proportional to 

tt* + 1/ 

and hence for the distribution of a and we find 


dF oc 


exp { — a + p^a)da 


1 * 

(1 + M®) 2 ' 
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Hence the cUstrihutions of a and n are independent, and for that of u we have 

du 


dF oc 


71 - 1 ’ 

(1 + 


This distribution does not contain any of the parent parameters. If we put 

(fea ^2)^1 
(si - 

then t is distributed in “ Student’s ” form 

dt 


t — u\^(n — 2) 


dF cc 


/ /2 \n~i 

. --2) 


. (14.71) 

. (14.72) 

. (14.73) 


and may be tested accordingly. 


Example 14.9 

Tn Example 14.3 we found for the regression of Y (potato yield) on X (wheat yield) 

(Y - 6-003) 0-0783 (X - 15-791). 


The regression eoeflicient is small. Could it have arisen from a population in which there 
is no correlation, i.e. in which == 0? 

From Example 14,3 we have 


-- ()-07.s3 

Hence from (14.72) 




- 4-1749, 4 
-- 2-06. 


0-5340. 


A])pendi\ Table 3 does not (‘arry ns as far as r = 46. From the Fisher-Yates tables, 
however, we have the following values of f for P = 0-05 : 

V 40 t — 2-021 ; v = 60 f 2-000, 

and for P 0-02 : 

r -= 40 / -= 2-423 ; r =- 60 f 2-390. 

Thus in our ease evidently lies between 0-05 and 0-02, and the regression may not be 
significant, i.e. the two variates may be independent. 44iis confirms the conclusion 
reached in Example 14.6 from consideration of the correlation coefficient. 


14.22. Up to this point we have considered th(‘ correlation coefficient mainly as a 
measure of the relationshi]) between two variates, and tliis is the standpoint which will 
mainly concern us in this and the succeeding chapter. We may, howevcu*, turn for a time 
to a consideration of the regression equations, which have an importance of their own. 
Assuming that the regression is approximately linear, we have two equations 


X X ^ f$,iY - y)\ 
Y (i,{Y - x)l 


. (14.74) 


expressing the relations between the means of variate arrays and the variate-values deter¬ 
mining those arrays. A problem which frequently presents itself in practice is the following : 
given a member of the population exhibiting a variate-value x, what is its y-value ? Evidently 
there is in general no unique answer to this question. For any given x there will be an 
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array of ^’s, any one of which might be exhibited by the member under oohsideration. 
But in the absence of any special knowledge it is reasonable to take as the best estimate 
of y the mean of this array. If the population is normal the mean will be the modal value, 
and if it is approximately normal the mean will be a reasonable estimate, the greater part 
of the population values lying distributed within a range of two or three times the standard 
deviation of the array. 

In fact, the question as put is too restrictive. There is no unique value of y corre- 
sjjonding to a given x, and we are entitled to enqxiire only after the distribution of j/’a or 
their principal characteristics. 

Now the mean required is given by the regression equation, and hence that equation 
may be used to estimate the «/-value corresponding to a given x. If at the same time the 
variance of the y-array can be determined, the probable limits of error of the estimate 
may also be assigned. This is particularly easy for normal populations because, as we 
have seen (14.8), the variance of all .r-arrays is af(l — p^) and that of the ^/-arrays ct|( 1 — p®). 
As usual in large samples, we can use the sample values to calculate thevse variances ; or 
we may take the variance of the array direct from observation. 

Example 14J0 

In Example 14.1 we found for the regression equations, in the units there employed, 

X - 0-7700 1*417 (Y + 0-2095) 

7 + 0*2095 = ~ 0*26r>8(X - 0*7706). 

Suppose we require to estimate the highest audible pitch for a man 34 j^ears of age. In 
our units this corresponds to an a:-value of ^34 — 22) = 4. Our estimate of y is then 

~ 0*2095 - 0*2658(4 - 0*7706) 

— 1*0679 units. 

This corresponds, in vibrations per second, to 

19,995 --- (1*0679) x 2000 
= 17,900 vibrations. 

The variance of the estimate is t'?i(l — r^) 

== ]3*3482{l (0*6136)5^} thousands^ 

= 8*322 thousands^, 

so that the standard error is \/^*322 = 2*9 units == 5*8 thousand vibrations. The estimate 
is evidently not very accurate, for the value of y can vary within two or three times this 
range without very great improbability. 

If the problem had been set in the reverse form : what is the age corresponding to 
a vibration of 17*9 thousands, we should have 

X = 0*7706 1*417(- 1*0679 + 0*2095) 

== 1*99 units 
= 27*98 years. 

This is not very close to 34 years, the age from which we started; and in general, if f is 
the estimate of x, given y = is not the estimate of y^ given x ^ We have a right to 
expect such a concordance only when r is near unity or when ^ and r] are near the means 
of the distribution, where the regression lines intersect. 
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The ComSa^ion^ Ea^ioa 

14.23. Eor any bivariate distribution we have, if Xp is the mean of the ^>th a*-array 
and X the mean of the whole, 

E{x — «)* r(x -T- Xp + Xp — x)* 

= i:(x — fp)* + — x)*, . , . (14.76) 

the product term 21i'(x — Xp)(Xp — x) vanishing because Xp — x is constant for any given 
array. 

The correlation ratio of x on t/, rij^, is defined by 

^ E(Xp — xY 
E{x - xY 

and similarly that of y on x, by 

‘ £(y - yY 

AnalogouHly to (14.75) we have 

E{x ~ ^lyY -- E(x — Xp + Xp 


V’‘xy 


(14.76) 

(14.77) 


= Eix -XpY + - fi,yY. 

E{x - PiyY - (1 - p^)E{x — x)*, 


(14.78) 


But, from (14.11), 
and from (14.76), 

(1 - rYx,)E{x - xY = E{x - XpY- 
Taking these results in conjunction with (14.78) we find 

2’(x - m^Yxy ~ P^) = - fi,yY. 

Hence q cannot be less than p. If and only if q = p, Xp — (iiy vanishes for each 
array, i.c. the regression is linear, q^ — r* may thus be used as an index of linearity of 
regression. 

Example 14.11 

The calculation of the correlation ratios is based on equation (14.76). As an illustration 
we will find those for the data of Table 14.1. The means of the horizontal arrays and the 
array frequencies are shown in Table 14..5. 


TABLE 14.6 


Calculation of the Correlation Ratio for the Data of Table 14.1. 


Highest 

Audi bio Pitch 

Froquoncy 

Mean 

Xp X 

- xY^ 

r>-^ 

3 

4 666,607 

3 806,025 

15 179,011 

1- 

45 

911KU1 

8-340,469 

69-563,423 

9- 

10 

9 700,000 

8 929.368 

79 733,434 

11- 

104 

8 817,308 

8 046,066 


13- 

93 

6-333,333 

5 .562,691 

30-943,531 

15^ 

310 

3-022,581 

2-2.') 1,939 

5 071,229 

17- 

576 

1 064,236 

0-293,694 

0-086,197 

19- 

1051 

0-101,808 

- 0 668,834 

0 447,339 

21- 

957 

0 801,463 

- 1 572,105 

2 471,514 

23- 

105 

- 1-278,788 

- 2 049.430 

4-200,163 

25- 

41 

- 1-512,195 

- 2-282,837 

6*211,345 

27- 

16 

1-562,500 

- 2 333,142 

6-443,552 

29- 

2 

- 1 000,000 

- 1-770,642 

3-135,173 

31- 

2 

- 3-000,000 

- 3 770,642 

14-217,741 

33- 

4 

- 1-750,000 

- 2-620,042 

6-353,636 
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We have already found that 

2’(x®) = 47,392 i:(x) = 2604, 

from which 


- x)^ = i:(x^) - ^ (^(x))* 


From the table we now have 


= 45,385*25. 


= 19,095*88. 


It should be noticed that in forming this sum we multii)ly each (x^y — xy in the last column 
of Table 14.5 by the corresponding frequency in the second column, for the summation 
takes place over all values of x. 

We then find 


=- 


19,095*88 

45,385*25 


= 0*420,751, 


giving riji.y = 0*6487. Similarly it may be shown that = 0*6231. The correlation 
coefficient is — 0*6136. 

We have 

= 0*044 
0 - 012 . 

These values are close to zero and the regressions are thus approximately linear. 


14.24. We shall see in the next chapter that is closely related to a statistic R, the 
multiple correlation coefficient, which is of rather greater importance. We accordingly 
defer a full discussion of the sampling distribution of until that cliaptcr, but will hero 
derive it m the s^iecial case of samples from an uncorrel/ited bivariate population. 

From (14.75) and (14,76) we have 


1 ^ l\x 

rr ~ - xY 


. (14.79) 


Now if the population is normal and tlu* aiiays aie of narrow width, the distribution 
in each array will be normal. We have already seen that in a normal distribution the 
mean is distributed independently of the variance Hence 2^{r —• which is the sum 

of numerical multiples of array variances, is independent of the array means and hence of 
the quantit}^ Z{Xp — Thus the numerator and denominator of (14.79) are independent. 

Further, if the variates are uncorrelated and therefore (in the normal case) independent, 
the distributions in parent arrays have all the same mean and variance, those of the total 
distribution. Without loss of generality we may take the moan to bo zero «and the variance 
to be unity. 

It was seen in Example 10.5 that the sum of squares of a variates, each distributed 
normally with zero mean and unit variance, is given by 

dF oc dt .(14.80) 

and that the distribution of sum of squares about the mean is the same in form but has the 
index of i reduced by unity. Now U{x — summed over any given array containing 
Nyy members is the sum of squares about the mean of Nj, variates and is thus distributed 
in the form (14.80) with — 1 degrees of freedom, that is to say with a = — 1. 
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Thtis the mm (ac -- tL)* for the whole array will be distributed in the form (14.80) with 
X. (Np — 1) » iV — jp degrees of freedom, i.e. as 

^ dJP qc 6^*^ . 


(14.81) 


The mean will be distributed in the normal form 

dF 


and consequently which is equal to ^ £)^ (the summation now ex- 

p 

tending over the p arrays), will be distributed in the form (14.80) with p — 1 degrees of 

freedom ; i.e., writing u for the sum, as 

dF .... (14.82) 

1 — t 

wo then have to find that of ^ and m being inde- 


To find the distribution of 

Yj^ U 

pendent. 

We have for the joint distribution 

dF oc exp \ — l{t + u)\ 

Put Z t + u, 

u 

The Jacobian of the transformation is 

a(^, 0 ^ t + u 
d(t, u) 

and (14.83) becomes 

, ^J(A P 2) 

' dFcce 

Thus and C are independent and we have for the distribution of i 

tHA -P 2) 

(1 4 - • 


(14.83) 


(14.84) 


whence, on putting f 


we find 


p-:i 


dF ex (1 /y 2 )i{iv P-2) (^^ 2 ) 2 d{ri^) 
fN - I p _ i\ - ,,*)iuv-i> -2) (,;*)l(».-:«) 

2" ’ ~2 ~) 
which is the distribution required. 


«c 


(14.85) 


14.25. The distribution function of (14.85), which is a Pearson Type I curve, may 
be obtained from the incomplete i?-function. It is sufficient for ordinary purposes, however, 
to use the tabulated forms of Fisher’s 2 ;-distribution (Example 10.18). In fact, putting 
in (14.85) 

^ P I 

V, «= — p 

^2 N ^ p 




1 — 17 * ^ 


AA 


A.S. 
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dF oc 




the form of equation (10.62). Appendix Tables 4 and 5 give the values of z, such that equal 
or greater values will be attaint with probability 0*05 and 0*01. These tables are due 
to Fisher and reproduced from his Statistical Methods for Research Workers, In practice, 
however, r}^ is only calculated for large values of N outside the range of these tables, and 
we may either use the approximation suggested therein or special Tables by T. L. Woo 
reproduced in Tables for Statisticians and Bicnnetricians, Part II. 

14.26. It is easy to show that the first two moments of (14.85) and the constants 
yi and y, are given by 

- 


/^i 

o 

n 

72 


N - l . 

2(p ^J){N ^p) 

{N - l)2(iV 4-1). 

16(A^ ^ 2p + l)^N 4 1) 

(p ^ 1)(N - p){N 4- 3)^- * 

e(N 4- l)mN - 1)2 + (p + 1){N -p)(N - 13)} 


(14.86) 

(14.87) 

(14.88) 

(14.89) 


(^_i)(isr~-p)(is^ + 3)(ivr4-r>) 

Thus, to order 

16 

n 

p - 1 ! 

and thus does not tend to normality for large N for any finite numbc^r of arrays p. 


rf- 


72 


(14.90) 


Tetrachoric r 

14.27. We now proceed to consider two coefficients designed for the measurement 
of dependence and based on the product-moment correlation coefficient, tetrachoric r and 
biserial t]. Both those coefficients are, in effect, estimates of a putative product—moment 
correlation for data which are not specified with the detail of an ordinary bivariate table. 

Suppose we have a fourfold table 


a 

b 

aft 

c 

1 

d 

4- 

a- 

1 

a + c 

6 4* d 

N 


If this table is derived by a double dichotomy of a bivariate frequency-distribution 

1 


Z = 2o ®Xp 


1 2(1 - p^)\at a,a, ^ <7l)l 
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may ask^ what is the value of p in terms of a, 6, c, d and N ? This problem is, in fact, 
determinate. 

If the population is normal the array totals will be normal, and thus the frequencies 
{a + c) and (6 +d!) correspond to a dichotomy of the normal curve, i.e. there exists an 
h' such that ' 


z dx dy 


a -f c 
b + d 


or 


1 


(7iV(27r), 


r:j: 

£ -J 


(14.92) 


+_C 

N 




bj-d 

- 


h' 


Putting li — -- we have 

j" exp (— dx — 

£ exp (- ix2) rix 

SO that h can be derived from the tables of the normal integral. 
Similarly there will be a k defined by 

I exp (- \y^) dy = 1"- (2^). 

We then require to solve for p the equation 


(14.93) 


d _ 

N ~ 2n{l 


We will expand the integral on the right in ascending powers of p. The characteristic 
function of the distribution is 

m, u) = exp {- l(t^ 4- 2ptu + u^)}. 

Thus 

ti “ «■•£ '4. ''"I-1-. 


I ^ dtdu (14.96) 

The coefficient of (— py is the product of two integrals, the first of which is 

1 pco poo 

— 1 dx\ exp (— 
h J ~oe 

and the second a similar expression in L% y and u. Now from 6.24 the integral with respect 
to t is equal to 
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and hence the double integral is 


Hence, from (14.96), 



1)'-* P (x) 



N p 




2n 


Ixi the notation of 6.27 we write r for the tetrachoric function of h and x* for that of 
and we then have 


^P^r,r, .( 14 . 96 ) 

The tetrachoric functions have been tabled up to Ti^ {Tablei> for Statuiicians and Bio- 
metricians, Parts I and II) and, with their aid, (14.90) can be solved by successive approxi¬ 
mation. Examples will be found in the introduction to the Tables. 


14.28. It is to be realised that the coefficient obtained by the solution of 
equation (14.96) is not a productr-moment correlation, but an estimate of the parameter 
in a bivariate normal population. It is not an estimate of the product-moment correlation 
in non-normal populations. Its practical use is limited largely by arithmetical incon¬ 
venience, both in the solution of (14.96) and in the determination of sampling variances. 
Karl Pearson (1913) has given expressions for these quantities, but as nothing is known of 
the distribution of tetrachoric r it is not clear how far the use of a standard error is justifiable. 


Biserial tj 

14.29. Suppose now that we have a 2 x g-fold table, the dichotomy being according 
to some qualitative factor and the other classification either to a numerical variate or to 
some variate permitting the arrangement of the classes in order. 

Table 14.6 will illustrate the type of material under discussion. The data relate to 


TABLE 14 6 

Showing 1426 Criminals classified according to Alcoholism and Type of Crime. 
(C. Goring’s data, quoted by K. Pearson, 1909.) 



Arson 

Rape 

Violence. 

Steahng. 

Coming. 

Fraud. 

Totals. 

Alcoholic. 

60 

88 

165 

379 

18 

63 

763 

Non-alcoholic 

43 

62 

110 , 

300 

14 

1 

144 

673 

Totals 

93 

150 

265 

i 

679 

_ _ _ j 

32 

1 ' 

* 207 

t 

1426 


1426 criminals classified according to whether they were alcoholic or not and according to 
the crime for which they were imprisoned. The order of the crime-classification is deter- 
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mined by its r^tionship with intelligenoe, arson being associated with low intelligence and 
fraud with high. 

If the population is normal, t] = p. We have 

Wp - P)* 

^ jfJC "aT 

V* Jv var y 


= r (^i» 9py + g») 

N var y 


Since 


z(lpyj>y'' 

\N var y y 


\N var y) 

, y- 

N var y 


var y 




var y 


(14.97) 


i r ^pyp- jEJp _ yl- 

N var y^^ ‘ var y var y 


(14,98) 


But the mean variance of arrays, weighted according to the numbers in arrays, 


var y(l 


var ^(1 — Taking this as equal to var y^ we have 


giving 


VA var yj 

^pyp\ _ 

var y^} var y 

1 

N \var yj 


_r 

var y 


. (14.99) 


The use of this expression lies in the fact that the quantities in it can be estimated 
from the data on C/Crtain assumptions. If we suppose that the quantity according to which 
dichotomy has been made (in our example, alcoholism) is capable of representation by 
a variate which is normally distributed, and thus that each y-array is a dichotomy of 

a normal curve, the quantities - , ^ and — can be obtained from the tables of 
^ \/var^ V var j/p 

the normal integral. For example, the two frequencies alcoliolic and non-alcoholic are, 

50 

for arson, 50 and 4,3. Thus the proportional frequency in the alcoholic group is ™ 0*5376 

and the deviation corresponding to this frequency is seen from the tables to be 0 0946, 

y 

which is thus —— for this w-array. 

Vvar y^ ^ j 

Example 14J2 

For the data of Table 14.6 the proportional frequencies, the values of 
the Nj, are as follows :— 


Alcoholic . 
9p/ Vvar 2/, 


Arson, Rape. Violenco. Btoalmg. Coinmg. 
0*5376 0*58(57 0*5849 0 5582 0*5626 

0 0944 0*2190 0*2144 0 1463 0*1673 

93 160 265 679 32 


Fraud. Total, 

0*3043 0*5281 

- 0 6119 0 0704 

207 1426 
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Then from (14,99) we have 

} (0*0704)» 

+ . . . } 


which, on our various assumptions, may be taken as approximating to the supposed product- 
moment correlation coefficient. 

As for tetrachoric r, the sampling distribution of biserial 7 ] is unknown. Expressions 
for its sampling variance have been derived by K. Pearson (1915), but are to be used with 
considerable reserve. 

14*30. Something may also be said about the assumptions on which tetrachoric r and 
biserial rj are based, particularly that of normality. In supposing that a given fourfold 
table is the double dichotomy of a normal population, we are assuming that the attributes 
or variates concerned are capable of representation on a normal scale and that it was, in 
fact, this scale which determined the classification given. This assumption is evidently 
a considerable one and cannot alivays be made with much confidence. In dividing criminals 
into alcoholic and non-alcoholic it would, for example, be assumed that alcoholism ” 
is a quantity which varies continuously from one subject to another; or perhaps that 
propensity to alcoholism was such a variate. At one end of the scale w^e should liave 
chronic inebriety, at the other the most austere teetotalism. It would be further assumed 
that if the degree of alcoholism could be measured, the population of criminals would be 
distributed according to the alcoholic variate in a normal form ; and it would be further 
assumed that the data which are given would have been arrived at by a dichotomy of the 
population according to the variate. How far assumptions of this kind are justified depends 
on previous knowledge and the circumstances of individual cases ; but even so it remains 
largely a matter of personal opinion. The reader will meet widely divergent views in the 
literature of the subject. 


1426 


giving 


{93(0-0944)2 4- . . . 

^ 0*05450 
rj = 0*234, 


Intra-’class Correlation 

14.31. There sometimes arise, mainly in biological work, cases in which we require 
the correlation between members of one or more families. We might, for example, wish 
to examine the correlation between heights of brothers. The question then arises, which 
is the first variate and which the second ? In the simplest case we might have a number 
of families each containing two brothers. Our correlation table has two variates, both 
height, but in order to complete it we must decide which brother is to be related to which 
variate. One way of doing so would be to take the elder brother first, or the taller brother ; 
but this would provide the answer to different questions, the correlation between elder and 
younger brothers, or between taller and shorter brothers j not the correlation between 
brothers in general. 

The problem is met by entering in the correlation table both possible pairs, i.e. those 
obtained by taking both brothers first. GeneraUy, if the family contains k members, there 
will be k{k — 1) entries, each member being taken first in association with each other 
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member second. If there ore p families with * kp members there will be 

^kjjkj — 1) entries in the correlation table. As a simple illustration consider five families 

f 

of three brothers with heights 

1st family 69, 70, 72 inches 

2nd family 70, 71, 72 „ 

3rd family 71, 72, 72 „ 

4th family 68, 70, 70 

5th family 71, 72, 73 ,, 

There will be 30 entries in the table, which will be as follows :— 


Height (inches). 


73 



08 

09 

70 

71 

72 

1 

( 

' 73 

Totals. 

08 

— 


2 

-- 


! 

2 

09 


— 

1 

— 

1 

— 

2 

70 

2 

1 

2 

1 

2 

— 

8 

71 

1 


1 

— 

4 

1 

0 

72 

1 

1 _ 1 

1 

! 

2 

4 

2 

1 

10 

73 

— 


” 1 

1 

1 

— 

2 

Totals 

2 

2 

H ! 

1 

6 

10 

2 

30 


Here, for example, the pair 69, 70 in the first family is entered as (69, 70) and (70, 69) 
and the pair 72, 72 in the third family fvnee as (72, 72). 

The table is symmetrical about the diagonal, as it evidently must be. We may calculate 
the product-moment coefficient in the usual way. We find var a- ~ var y = 1*716, 

oov (xy) = 0*516 and hence p ™ ^ 0*301. 

The actual compilation of such a table is, however, both tedious and unnecessary. 

The coefficient p can be found by direct methods, as follows :— 

Suppose there are p families, with variate-values j\i . . . x^i . . . , . . 

0:^1 . . . the families numbering/ri,/t *2 . . . k^. In the correlation table each member 

of the A'th family will appear times (in association with the other members of the family), 

and thus the mean of each variate is given by 

^ = y == i ^{(K - 


(14.100) 
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the first eununation taking place over the p families and the second over all members of 
the tth family. Similarly 

vara: = var y = — 5)®} . . . (14.101) 

and cov (xy) = Z (®« — — x), • • • (14,102) 

^ i i. I 

the summation Z extending over all possible pairs for which j ^ 1. Thus the coefficient p is 
given by 

27 27 (Xij — *) (% — x) 

J _.(14.103) 

^ Z(kt- i) Z {ntf - x)» 

i i 

This can be thrown into a rather more convenient form. We have 

^ ^ (^ij — — x) E Z' — x)(x^i — x) — E E (x^j — x)^ 

i Ul i il ' If 

(where the summation E' now extends over all possible pairs, including j ^ 1) 

n 

- 27 ]c\{x, ^ x)^ ^ EE {X,, ^ x)\ 

i i 7 

% being the mean of the ith family. 

Thus 

E kf(x^ -^E E{x^^ - x)2 
P = — 


f* / 


E{k, ^ 1) E {x,^ ^ xy 


(14.104) 


(14.105) 


If all the families have the same number of members this formula is somewhat simj)lified. 
Denoting by v the variance of x, and by the variance of means of families (about the 
mean £), we have 

(k — l)pkv 


{k 




(14.106) 


The coefficient p is called the Intra-class Correlation Coefficient, to distinguish it from 
the ordinary product-moment coefficient. 


Example 14.13 

Let us use formula (14.106) to find the intra-class coefficient for the example of the 
previous section. With a working mean at 70 inches, the values of the variates are 

-^ 1 , 0 , 2 ; 0 , 1,2 ; 1 , 2 , 2 ; 2 , 0 , 0 ; 1 , 2 , 3 . 

Hence x = ^ ^ ^-^{(- i)* + o® +...}= 


var {x) — 


3^ 

226’ 


^ lj5 25 - 10 30 
16’ 16’ 16’ “16“’ 15’ 


The means of families are 
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taoA deviations from £ 


-8 ^ 12 ^23 17 
16 ' 16’ 15’ 15"’ 16' 


Thus 


= ^30 
1125' 


Hence, from (14.106) 

_ 1(3.1030.225 
^ “ 2\ 1125.386 
= 0-301, 

a result we have already found directly. 


-- 1 


} 


14.32. One caution is necessary in the interpretation of the intra-class correlation 
coefficient. From (14.106) it is seen that intra-class p cannot be less than t—— r, though 

fC A 

it may attain 4-1* It is thus a skew coefficient in the sense that, unlike product-moment 
correlation and association, a negative value has not the same significance (as a departure 
from independence) as the equivalent positive value. 


14.33. The samplmg distribution of intra-class p for the case of a normal population 
and equal numbers in families may be obtained as follows .— 

It may be shown, precisely as in (14.25), that the ratio of two sums of squares about 


means, f based on N 


p and p — 1 sums, is distributed as 


clF a: 


viOV-D’ 


(14.107) 


provided that the sums are independent and emanate from normal populations. Here 
a|, erf are the population variances relating to re 8 pectivel 3 ^ 

Consider now p families of k members, pk in all, as p samples of k from a normal popula¬ 
tion in which the intra-class coefficient is A. Wnting I for the sample intra-class coefficient 
we have 


- - 1 ). 


where f =?= Now relates to means of samples and is distributed independently 

of V — as in the case of (14.25). We may therefore substitute for ^ in (14.107), with 
N “ pk and p p. Furthermore, since the population value of v — is erf and that of 

V have 


1 \(k-l)al+al j 

^_ 

(k - 1) af + ’ 


. (14.109) 
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After a little reduction (14.107) becomes 

Pik" 1) 2 

{1 -- A + X{k --- 1)(1 -Z)}“V 

As for the product-moment coefficient, this form may be brought closer to normality by 
putting 

I = tanh 2, A = tanh C. 

In the particular case i* = 2 we find 

e sech'Pz dz 

dF oc 

cosh^^' — f) 


r{7i - I) 


sech 


. (14.111) 


r{n - l)V(27r) 

which has the I'emarkable proj>crty of depending only on z — C, i.e. of being the same in 
form for any C or A. Writing s - C -- x we may derive from (14.111) the expansion 


Fin — 1) ^ ij. r, w — 1 

^ r{v - l)\"(27r) L ^ 12 

'}][' 


(»- 1) 


, j:* , 5.c3 , Mr* 

lx — 4 _ 4 

8 ^ 48 384 




giving 


Hi = — 


2{« - 1) 


1 + + . . . 
^ 2{/, - 1) ^ 


/t2 


1 -f ^ ^ 4- 

2(w - 1) 6(« - 1)2 ^ 


- (n - 1)3 + 




1 

(W - 1)2 


3 4- 


whence 


Ti 


5 19 

- 1 ^ 4{v - 1)2 

1 


{n - 1) 

2 

y2 = - -1- 


1 


(14.112) 
. (14.113) 
. (14.114) 
, (14.115) 
. (14.116) 
. (14.117) 
. (14.118) 


V ~ I ' (/z, -- 1)2 

illustrating the tendency to normality, z - C may be taken to be distributed normally 
about zero mean with variance ^ 


{n 


“ afjproximately. 


For the general case the substitution 

2(^’ ~ ])l = k — 2 -{- k tanh {z - 0) 
2{k ~ 1)A - k ~2 + k tanh (C - 0) 

k — 2 

where tanh 0 = - , reduces (14.110) to 


. (14.119) 


t-;') 


kp i 

2 r{(ic - i)p - 2}r 


fs') 

pic 


exp 


{k — 2)p f 1 
o 


{x~e) 


where, as usual, x ~ z — t. 


X sech " (x — 0) dx . 


(14.120) 
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EXERCISES 

14.1. Show that the data of Table 1.25 have the following constants (,r == age, 
y =s milk yield): 

mean z = 6-22 years. mean y = 18*61 gallons. 

\/{va,r x) = 2-21 „ V(var y) — 3*37 „ 

p - 0*219, - 0*242, - 0*266. 

14*2. Show that for the data of Table 14.2 

p = — 0*014, = 0*14, =r 0*38. 


14.3. Show that the smaller angle between the regression lines is 


arc tan 


oTia, 


-f 


14.4, If a bivariate normal surface is dichotomised at its medians and a is the pro¬ 
portional frequency in the positive compartment of the 2x2 table so generated (i.e. the 
compartment including the limits -f oo), show that 

p = cos (1 — 2x)n. 

(Sheppard, Phil, Trans, Roy, 8oc,, 1898, 192A, 101.) 


14.5. Show that the ordinates of the sampling distribution of the correlation coefficient 
r in samples from a normal parent with correlation p obey the recurrence relation 

2n — \ , n — 1 

where n is the sample number and 

pr v/(l - p^) V(1 - r^) ^ (1 ~ P^)(l - r^) 

(Co-operative Study, 1917.) 


14.6. By the transformation cosh z - pr 


distribution of r may be expressed as 

^ 2 {I - p^rr" (1 - r2)“2^ y> 

VV^} n _ r(n 


1 — pr 

show that the ordinate of the 

1 { u 


l/n 


1 + 


where a 


i! 

2* yi — I 

= ^ 

2 ” 


(1 --- pr) “ 2 - 
1^*1" 


+ 


1) 

j) 

1*.»*.5* 


^)(« + i) 2*.2^2* {n - i)(n + \)(n ~ J) 


f 




14.7. Show that the characteristic function of 

„ pZxy 


0, 


2(1 - 




(1 — p*)<Tiaa’ 



Z{y^) 




in nonntd samples is 


DXEBOBSS 


36S 


(1 - P ^W __ 

{(1 - i<,)(i - ih) ->*(1 + 

where 4 refers to 6i, and so on. Hence show that the distribution of vaiianoes and co¬ 
variances has the same characteristic function, except for constants, but with the value 
of n reduced by unity. Show that the simultaneous distribution of these quantities is then 
that of equation (14.42) with Qt = tm, 0, = npb, 0, == nc. 

(Kullbaok, 1934.) 


14.8. From the distribution of equation (14.42) show that the distribution of 


V 


~ I and r is given by 

CTi/ Og 

dF oc 


n—4 

^n-^(l _j.i) 2" 
(1 —~2^ 


dr dv. 


Integrating for r from — 1 to -f 1 by putting 

. _ u(A -f /«) — (1 — u){X — n) 

^ u{X -f yu) -I- (1 -- u)(X — fj)’ 

show tliat the distribution of v is 


A = 1, 4- V*, 


fx = 2pv, 


T?j-1 

^ ^ P^) J. __ . 

/n - 1 1\ (I ‘ 

V 2 ’ 2 ; 

(This gives the distribution of the variance ratio when the variates are correlated. 
The result is due to S. S. Bose (1935), Sankbyd, 2, 65. The derivation was given by 
Finney, Biometrika, 1938, 30, 190.) 


14.9. Show that in samples from a normal bivariate population the variance of is 
given exactly by 

var(6.) 2(1 -/>*) 

n — 3 (Tj 

and that for the distribution of 

yi 0 

6 

= n-~6- 

14.10. By considering the joint distribution of Sj and 6, in normal samples, show that 
the regression of 6, on Sj is linear, but that of Sx on 6, is not linear and does not tend to 
linearity for large samples. 


14.11. Writing the bivariate frequency function in the form 

/(a;, y) =/(*) 0ar(y). 

so that the jth moment about the origin of the y array for given x is 



Parent, 
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show that 


(where ^ is the characteristic function of the distribution) so that 




dU 


Verify that the bivariate normal distribution has linear regressions and is homoscedastic. 


14,12. (Data of E, M. Elderton, quoted by K, Pearson, 1910.) The following table 
shows 811 sons classified according to alcoholism of parent and health of son :— 





Son. 





( 

1 

Healthy. | 

Fairly 

healthy. 

f 

1 Delicate 

1 

Phthisical or 
epileptic. 

Died 

young. 

Tot als. 

Alcoholic . 

1 

122 

9 

24 

8 

42 

' 20^) 

Non-alcoholic 

328 

37 

71 

i 

37 

133 

606 

Totals 

1 450 

46 

95 

46 

175 

811 


Show that biserial 7] — 0 089, indicating little correlation between health of son and 
consumption of alcohol by parent. 


14.13, (Data from O, H. Latter, Bkmetrika, 4, 3905, p. 363.) 

The following table shows the length of cuckoos’ eggs fostered by various birds *— 

Length of Egg (unitR J millimetre) 


Foster Parent. 

40 

1 41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

T OlALS. 

1 

Robin. 1 

1 

1 

8 

1 

3 

9 

13 

20 

6 

11 

2 

2 

76 

j 

Wren. 

7 

5 

14 

8 

9 


3 

2 

— 

— 1 

- 

54 

Hedge-Sparrow . . j 

— 

— 

2 

5 

14 

13 

13 

3 

5 

— 

3 

58 

! 

Totals j 

1 

8 

6 

1 

16 j 

32 ! 

I 

32 

30 

11 i 

16 

2 

6 

188 


Show that the coefficient of intra-class correlation is + 0*22. 


14,14. A series of measurements are subject to errors of observation which may be 
supposed uncorrelated with the magnitudes of the measurements. If Xi, refer to the 
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observed deviations from arithmetic means and x, y to the tme deviations, show that 
= ^{xy), hut that var Xi > var x ; var yi > var y. Hence show that the observed 
correlation is less than the true correlation. 


14.15. If three variables Xt, X„ X, are uhoorrelated and the deviations are small 

X 

compared with their mean values and show that the variance of ^ is 

Ajj 

approximately 

dff/var X, 2 cov (Xi, X,) var X,\ 


f/var 1 

irm 


Ml\ M\ 

X X 

and that the correlation between ^ and ~ is 

A 3 As 


where 


var Xi 


■y/{vf + Vl){vl + vi) 


Note that this is positive, so that there is a ‘‘ spurious ’’ correlation between the two 

indices ^ and 

A 3 A 9 




CHAPTER 15 


PARTIAL AND MULTIPLE CORRELATION 

15.1. The produotr-moment coefficient of correlation can, as has been seen in the 
last chapter, be used to measure the relationship between two variates which are distributed 
either exactly or approximately in the normal form. When we come to interpret such 
a correlation, however, we meet the same sort of problem which arose in Chapter 13 in 
connection with associations : if a variate 1 is correlated with a variate 2, may this not 
be due to the fact that both are correlated with a variate 3 ? The question may be decided 
by considering the correlation of 1 and 2 in the sub-populations for which variate 3 is 
constant, and in this chapter we consider the theory of such partial correlations, which 
bear an obvious analogy to the partial associations of Chapter 13, The subject may best 
be broached by extending to several variables the theory of linear regression developed 
for two variables in the previous chapter. 


15.2. Suppose, in fact, that there is given a set of N individuals considered according 
to p variates otj, x^, . . . x^, so that to each individual there correspond p variate-values. 
We may, for e^i^ample, be given a sot of men according to height, weight, age and income, 
or a set of counties according to wheat-jdelds, hours of sunshine per annum, inches of^ 
rainfall per annum, and mean height above sea-level. In general, any variate may 
considered as dependent on the others and for any variate, say Xi, we may require tq fihd 
the ‘‘best*’ linear relation of the form 

Xi — a + 3 Pf)X^) . . . ip . (15.1) 

a generalisation of (14,8). As before, the constants may be determined by^he principle 
of least squares, i.e. so that 

U l\Xi - a - - ... — .... (15.2) 

is a ininimtim, the summation extending over the N members of the population. We 
shall then have 

dU 

di ^ — ... — ppX^) “ 0, . . . (15.3) 


and if we take the variables measured from their means, this reduces to a = 0. With 

this convention we have (p — 1) equations of type = 0, i.e. 

^Pk 




^pXp) - 0 


or 


cov (.Tfc, Xi) - cov x^) . . . - Pk var Xj, - cov (x^^) = 0, 

* - 2, 3, ... p. . , (16.4) 

These (p — 1) equations can be solved for the (p — 1) quantities ^ and hence the required 
form (15.1) IB determinate. 


15.3. In the notation introduced by Yule we write 

Xi = + Pu.u...p^^ + . . . -f" X. 
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. (15.5) 
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which is the regression equation of Jfi on Xa . . . referred to the means of the variates. 
The quantities ^ are called Partial Regression Coefficients. The first subscript to the left 
of the period in each /? is that of the variate on the left of the regression equation, and 
the second subscript is that of the variate to which j[t is attached. These are called Primary 
Subscripts. The subscripts on the right of the period are those of the remaining variables 
and are called Secondary Subscripts. 

When no confusion is likely to arise we can write (15.5) in the simpler form 

Xi = + . . . ftpXp, ..... (15.6) 

that is to say, we may drop the first primary and the secondary subscripts. 

The order of the primary subscripts is material, being different from ^21 k J but 
that of the secondary subscripts is not. 

Write 

^'1 n p = ‘^'1 ~ Pn :u — • • • Pip 23 * • ( 15 . 7 ) 

a’i23 p ^way then be called the residual of x of order p. It is the difference between 
the observed and the value given by the regression equation. If all the residuals are 
zero, and only in this case, the regression is exactly linear. The were determined so 
as to make the sum of squares of residuals a minimum. 

Write also 

var (xi 23 ,.) = 2j „.(15.8) 

SO that oTj 23 p the standard deviation of residuals and corresponds to the standard 
deviation of arrays considered in 14.22. 

15.4. From (15.7), equations (15.4) may bo written 

•**1 it „) = (», A- -- 2 . . . . . . . (15.1)) 

and generally we shall have 

12 0 - 1)0 I'D p) ~ t), j ^ ki . . . (15.10) 

i.e. the (‘ovariance of any residual and any variate is zero, provided that the subscript of 
the latter occurs among the secondary subscripts of the former. 

More generally still, 

34 p ^2 31 p ) '^{•^1 31 p (•*’2 " /^23 4 P^’i . . . ~ 31 { p - l )^ p )} 

and each term on the right vanishes in virtue of (15.9) except the first, so that 

-^(‘^134 p) “ X(Xi 3^ ,p ^ 2 ) • • • (15.11) 

Xix, x. . p ) ^ • .(15.12) 

by symmetry. 

Thus the covariance of any two residuals is unaltered by omitting any or all of the 
secondary subscripts of either which are common to both. Conversely the covariance of 
any residual with p secondary suffixes and a residual with those p secondary suffixes and 
q additional ones is unaltered by adding to the former any of the q of the latter. 

As a corollary, any covariance is zero if all the subscripts of one residual occur among 
the secondary subscripts of the second. 

15.5. Tn virtue of these results wo have 



p 23 

p) 

11 

,j (^1 - 

Pj2 34 p -^2 “- • • •)} 

X(.r2 31 


Pl2 34 p 34 p ^ 2 ) 

=- 34 

p *^1.34.. 

,p) ~~ Pv2 34 ..p -^(^2 34 


A.S. 


B B 
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and thus, writing q for the* group of suffixes 34 , . . p, we have 

cov 




12.fj 


a generalisation of (14.6). 
Similarly 


var (%.^) 


var{:r, ,)" 


(16.13) 


(16.14) 


We may then de&ote a coefficient = P12.34 ...p l^he equation 

P12.Q "== (^I2.q ^2l,q)^ 

cov (a^i.^, X2 g) __ 

{var (a^a.q) var '(iri.Jp 


(16.15) 


This is a generalisation of (14.10), is evidently the product-moment coefficient of 

correlation between Xj^ and X 2 q 

15,6t From p variates we can pick out two in ways and find the regression of 

each on the other and their correlation ; we can also pick out three in ways and find 

the regression of each on the other two ; and so on. The number of possible regressions 
and correlations is thus very large, but they can all be expressed in terms of the variances 
of the variates and the correlations between pairs. 

We shall call the coefficients with k secondary subscripts regressions, correlations, etc., 
of the Ath order. The correlation between a pair of variates is thus of zero order, and 
our result may be stated in the form that coefficients of any order are expressible in terms 
of those of zero order. The proof follows from the expressions which we proceed to derive, 
giving coefficients of any order in terms of those of lower order. We have 

-^(^1.23., p) ~ 23 23...p) 

23...(p^l) 23 (P-X)^p - ^^*“8 


Pip 




2.3 ,.(p~U^p 23.. (n-l)) f 


(15.16) 


— 23.. (p-1)) 

hence, dividing by N, 

var (a:i 23...p) — var (a;| 23 . .(p-i)) Ap 23 .. (p ~i)/^pi .23 ..(p-i) var (a^i 23 ..-(p-i)) 

= var {Xi 23 ..(p-d) (1 ~ Pip 23...(?j-l)) .... 

which may be regarded as a generalisation of (14.11). By continuing the process we have 

var ( 0 : 1.23 ,.p) = var (a-x)(l --pf 2 )(l -Pi 3 . 2 )(l - P 14 . 32 ) • • • 

(1 -Pfp. 2 .s..(p-i)) . .(15.17) 

^12)(1 P 13 . 2 ) 


or 


2 

^1.23 

'of 


p 


(1 


(1 ~ Plp. 33 ...(p- 1 )) 


. (15.18) 


The subscripts of the p’s can be eliminated in a different order, giving alternative forms 
such as 


23 . 


(1 - pfsKl - pf4.s)(l - Pf2.84) • . etc. 


Thus the variance of a residual of order p — 1 is expressible in variances of zero order and 
correlations of order p ~ 2 . 
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IS.7, Equation^ (16.4) may be written 

p%$ 34 p<yl Pn 2 p P23 ^2<^3 ♦ === 0 

Pl3 ^12 34 . p Pu <^2^3 ^13 2 p <^1 -'*.•== 0 

etc. Adding" the expression for Z(x\ 23 p), i*e. 

^ ^ 1 23. p ^12 34 p P12 ^1^2 ^13 2 p f>13 ^1<^3 = 

we have p equations from which, on elimination of the /?’s, there results 


^2 -2 

01 ^ «i 2.^ p 

Pi a O'lO’a 

Pi3 

. 


. 


Psi 0^0% 

a| 

Pas 0t0i 

- 


• 


pai 0^01 

pj2 

0^ 

• 


• 

= 0 


A\'rite 


Pik Phi- 

Dividing 

tlie ith 

row by and the irth column by cr^^, we get 

23 p 

pit 

Pis 

Pip i 



Pit 

1 

Pas 

P2p 

^ 0 . 

. (15.19) 

Pip 

P2p 

P3p 

1 



I 1 

pit 

pii 

* • • Pip i 



CO 1 

1 

ptt 

P2p 

• 

. (15.20) 

Pip 

Pip 

P3p 

1 




and coxi for the minor of the first row and column of this determinant. Then from (15.19)- 

0 






afoj 
a)u ’ 


. (15.21) 


Generally it may be shown in exactly the same way tliat 

COV {Xf j ?—1 M 1 p 1 7/el, »»4 1 p) 

where is fhe minor of the lih row and n?th column in (15.20). 

This result shows that the Vtoaiices and covariances of residuals of any order can 
be expressed in terms of the correlations and variances of zero order. 


(15.22) 


15,8. We have, as in (15.10), 

-^(^1 34 p^2 34 p) -^(^1 M (p -J)^2 34 (p-1)) ~ /^2p M (p-l)-^{^l 34 (p-~l) •**?? 34 (p~l))* 

Substituting 

P‘2p 34 (p-1) ““ Pp2 34 (p-1) ^ 2 

«p 34 (P--1) 

and expressions for the covariances in terms of variances and regressions, and writing 
q for the group of secondary suffixes 34 . , , (p — 1), we find 

fin «p qp fin.q i] fixv q fip% 1 ] qy 
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whence, in virtue of (15.15), 

.(13.23) 

* r2p.Q Pp2.q 

expressing the partial regression coefficient in terms of those of next lower order. 
Writing down the similar equation for taking square roots, we find 


PVI.QP 


PVi (/ ^ Pip g p2iKij 

{(1 - ’ 


(15.24) 


a fundamental equation giving the correlation coefficient in terms of those of lower orders. 


15.9. From the above results it is clear that the whole complex of partial regressions, 
correlations and variances or covariances of residuals is completely determined by the 
variances and correlations, or by the variances and regressions, of zero order. It is inter¬ 
esting to consider this result from the geometrical point of view. 

Suppose in fact that we have .Y sets of observations of p variates 

Xii . . . Xip, X21 . . . X 2 py . . 

Consider a Euclidean (flat) space of .W dimensions. To each set of values 
there will corresjKind one point in this sjjaco, and the totality of jioiiits representing all 
observations will be p in number, (This method of representation, it should be Jioted, 
is not that of N points in a p-way space, which was the one used in some of the sampling 
discussions in Chapter l(t) Call these points Qiy . . . 4?^. We will assume that the 
arc measured about their moan, and take the origin to be F. 

The quantity xVer/" may then be inierpi'cte^d as the square of tlie length of the vector 
joining the point Qf{~ Xy, , , . x^i) to F. Similarly may be interpreted as the cosine 
of the angle Qi F for 

^ __ , 

which is the fonnula for the cosine of the angle between PQi and 

Our result ma;)^ then be expressed by saying that all the relations connecting the 
p points in the A^-space are expressible in terms of the lengths of the vectors OQ and the 
angles between them ; and the theory of partial correlation and regression is thus exhibited 
as formally identical with the trigonometry of an A^-dimensional constellation of points. 


15.10. The reader who prefr^rs the geometrical way of looking at thisr branch of the 
subject will have no difficulty in translating the foregoing equations into trigonometrical 
terminology. We will here indicate only the more important results required for later 
sampling investigations. 

Note in the first place that the p ]ioints Q and the point P determine (except perhaps 
in degenerate cases) a space of p dimensions in the A"-space. Consider the point ^ ..p 
whose co-ordinates are the A^ residuals Xj 2.. v virtue of (15.9) the vector 2...ay 

is orthogonal to each of the vectors PQ^ . . . FQ^^ and hence to the space of (p — 1) dimen¬ 
sions defined by P, . Q^. 

Consider now the residual vectors Qi,qy Q 2 g, where q represents the secondary suffixes 
34 ... (p — 1). The cosine of the angle between them, say 0, is each is ortho¬ 
gonal to the space P, Now take M on PQ^ such that MQ-^ and 

are perpendicular to Then MQi ^ is perpendicular to the space P, Qb, • • • Qp and 
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so is g. The oosino of the angle between them, say <f>, is /oi 2 ,,p (cf. Fig. 15.1). Thus, 
to express Pi 2 ,gp in terms of pi^.q we have to express </> in terms of 6, or the angle between 



the vectors PQi ^ and PQ ^^,,, in terras of that between their projections oji the hyperplane 
perpendicular to PQ^. We have 

{Q^ , Qt , t- PQi , ~ 2PQ, , PQ ,,cos e 

^ MQi 4 MQl ,, - , MQ ,,, co. 

Further PQi , -= PM^ 4- MQi ^ 

and PQi , - PM^ f- MQl ,, 


and hence wo find 


MQ^ MQ.> ,, COR <}> - PM^ + PQi PQ.^ cos d 


MQ, , MQ,^ 
PQi , PQ2., 


JL fi 

cos <p = cos d — - 

^ Vi q 


PM 
PQ2 q 


Now - is the sine of the angle MPQ^ ,,, the cosine of which angle 

^ Q\ q 

in (15.25) we find 


cos <f> 


cos 0 — P2/» q 

{(1 PI/. ry){ 


. (15.25) 
Substituting 


. (15.26) 


which is ecjuation (15.24) in a slightly different form. The expression of a correlation 
coefficient in terms of those of the next lowest order is thus capable of intei'pretation as 
the projection of an angle on to a space of one fewer dimensions. 


Eorample 15 A 

In an investigation into the relationship between weather and crops, Hooker (1907) 
found the following means, standard deviations and correlations between the yields of 
seeds hay (xi) in cwts. per acre, the spring rainfall (X 2 ) in inches and the accumulated 
temperature above 42"" F. in the spring (.rg) for an English area over 20 years 

.fi == 28*02 C7i ==- 4*42 piz = + 0*80 

= 4*91 0*2 = 1*10 pi3 = — 0*40 

^3 = 594 Ug == 85 p23 = — 0*56 
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The question of primary interest here is the influence of weather on crop yields, and 
we consider only the regression of ar, on the other two variates. Frcnn the correlations 
of zero order it appears that peld and rainfall are positively correlated but that yield and 
accumulated spring temperature are negatively correlated. The question is, what inter¬ 
pretation is to be placed on this latter result? Does high temperature adversely affect 
yields or may the negative correlation be due to the fact that high temperature involves 
less rain, so that the beneficial effect of warmth is more than offset by the harmful effect 
of drought? 

To decide this question, let us calculate the partial correlations and regressions. Prom 
(15.24) we have 

_ Pis Pi s 

- ~ ~ —_0-56) 

= 0-759. 

Pis z - 0-097 
Pi3 1 ~ — 0 - 436 . 

regressions p and the variances of residuals. From (15.14) we have 
_ cov (a;,sa ;2 3 ) 

^ var Xg 

^ Pl2 3 3 

^2 3 

This, however, involves the calculation of 3 and <72 3 which are not in themselves of interest. 
We can obviate the process by noting that from (15.16) 

^1 23 = CTj j(l 

<72 13 = Oo 3(1 P12 

SO that 


Similarly 

We next require the 


P 12 3 


P 12 3 ^12 3. 


The standard deviations 0,03 and are of some interest and may be calc ala tod from 
(15.18). We have 



(7i 23 — 

0,(1 - 

pU)Hi 

-pL.)* 



0,(1 - 

P?-i)*(l - 

Pi 2 

the two forms offering 

a check on 

each other. 


From the fii'st we 

have 





(7j 2 A = 

4-42 {1 

- ( 0 - 8 )- 

- 


r— 

2-64. 


• 

Similarly 

in -= 

0-594 




£^3 12 = 

70-1. 



Thus 

^12,3 

_ (0-759)(2-64) 
~ 0-594 ~ 

-- 3-37, 

and we also find 






/?13 2 =«= 000364. 





< 'I 


If 


n ^ d 

PAEim AND mkmm ooebelatipn 


375 


regresaion eqtotion of Xx on Zt md is then 

Xi -- 28-02 ^ 3*37(Xa - 4-91) + 0*00364(X» - 594). 

This equation shows that for increasing rainfall the yield increases and that for increas¬ 
ing temperature the yield also increases, other Ukir^gs being equal. It enables us to isolate 
the effects of rainfall from those of temperature and study each separately. The positive 
regression jiJis % means that there is a positive relation between yield and temperature when 
the effect of rainfall is eliminated. The partial correlations tell the same story. Although 
/>i8 is negative, positive (though small), indicating that the negative value of is 

due to complications introduced by the rainfall factor. 

The foregoing procedure avoids the use of determinantal arithmetic, but the reader 
who pi'efers to do so may use equations (15,21). For example: 


from which 


(A) 


COxi 


1 

0*80 

- 0*40 

0-2448 

1 

— 0*56 


= 0-6864, 


0*80 — 0-40 

1 — 0-56 

- 0-56 1 


-- 0-56 
] 



=: 2-64 as before. 


15.11 . When the work involves more than three variables it is desirable to systematise 
the arithmetic. Consideiable assistance may be derived from tables of qiiantities such as 


1 - p\ v/(l -- p^), 


1 

V(1 pf3)‘ 


Kelley (J916, 1938) and Miner (1922) have given tables for this purpose. Trigonometrical 
tables are also useful in some cases For instance, given p we can find 6 = cos“^p and 

hence RinO(= v'(l - p“)). coseoO^-= ^ etc. 


For determinantal work some systematic method of reduction such as the Doolittle method 
is useful. 


Eocample ^J5.2 

In some investigations into the variation of crime among cities ip the U.S.A., Ogburn 
(1935) found a correlation of 0*14 between crime rate (Xi) as measured by the number 
of known offences per thousand inhabitants and church membership (X-^) as measured 
by the number of church members of 13 years of age or over per 100 of total population 
of 13 years of ago or over. Tlie obvious inference is that religious belief acts as a deterrent 
to crime. Let us consider this more closely. 

If Xg — percentage of male inhabitants, 

X 3 = percentage of total inhabitants who are foreign-bom males, and 
X 4 «= number of children under 5 years old per 1000 married women between 
15 and 44 years old, 
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Ogbum finds— 

/>i3 + 0-44 

f)i3 = ~~ 0‘34 
Pi, =- - 0-31 

- - 0*14 

- + 0*25 


p,, = 0*19 
Paft ^ — 0*35 
p^, = + 0*44 
Pss 0*33 

/)46 == — 0*85. 


From this and other data given in his paper it may be shown that we have, for the regression 
of Xi on the other four variates, 


~ 19*9 == 4*51(Z2 49*2) -- 0*88(Xa - 30*2) - 0*072(Z4 -- 4814) f 0*63(Xr> - 41*6), 


and for certain partial correlations 

Pig 3 = 0*03 

Pi5 4 =- + 0*25 
pl5 24 ^ “f" 0*23. 

Now we note from the regression equation that when the other factors are constant 
Xi and Zc are positively related, i.e. church membership appears to be positively associated 
with crime. How does tliis effect come to be masked so as to give a negative correlation 
in the coefficient of zero order ? 

We note in the first place that the correlation between crime and church membership 
when the effect of .Tg, the percentage of foreigners, is excluded, is near zero. The correlation 
when 0 ^ 4 , the number of young children, is excluded, is positive ; and the correlation when 
both .Ts and a :4 are excluded is again positive. It api>ears in fact from the regression equation 
that a high percentage of foreigners and a high proportion of children act as deterrents 
to crime. Now both these factors are positively correlated with church membership 
(foreign immigrants being mainly Catholic and more fecund). These correlations sub¬ 
merge the positive influence on crime of church membership among other members of the 
population. The apparently negative effect of church membership appears to be due to 
the more law-abiding spirit of the foreign immigrants and the fact that they are also more 
zealous churchmen. 

The reader may care to refer to Ogburn’s paper for a more complete discussion. 


The Multimrmte Normal Distributmf 

15.12. We now turn to consider the generalisation of the univariate and bivariate 
normal distributions to the case of p variables. 

Consider the multivariate distribution 



(15.27) 


This has p variates and evidently reduces, whenp = 1 or 2 , to the normal type. We shall 
take it to be the generalisation of the normal distribution, and proceed to consider how 
the constants a are related to the correlations of the variates. It is, of course, assumed 
that the a’s are such as to ensure the convergence of the distribution function. For this 

JC tT 

it is necessary and sufficient that the quadratic form Z a . — — shall be positive-definite, 

i.e. that there is a real linear transformation reducing it to the sum of squares of p (or, 
in degenerate cases, fewer) new variates. 
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Make the tnmsformation 

^ = .(1.7.28) 

pTi 

and choose the Ts so that the exponent of (15,27) becomes — Then we have 

Uf, 

and hence, writing (a) for the matrix of the quantities a, (1) for that of the Ts and (?) for 
the transpose of (i), we have 

(«)(^)(0 = l.(15-29) 

Further, the Jacobian of the transformation is | Z |, the determinant of the Vs, and hence 
the integral of dF is given by 

yo 1 11 f • • • [ {- P}dii ... dip ^ (2jr)%o | 1 1- 

J CC J “ oo 


Hence, since from (15.29) | a| 

2/o 


12 = 1, we have 

{2n)l I 1 1 (2^)5 


. (16.30) 


Let us now find the characteristic function of the distribution. We have to integrate 
over the range of x’s the exponential of 


’[2’(^, - 2 if^a^ + 2’[(0'fc Wl- 

s 1 J,h r 


The first part reduces on integration to a constant. The second gives the exponential 
of a series of terms of second degree in t, the coefficient of being 

- mhr ^kr) 

1 

Now 2^ /jf. If^j. is the minor of the yth rov and Hh column in the matrix (/)(/) and hence, from 
(15.29), in the matrix (a)™ (A) say. Hence we may writ/t^ 

exp {|2: (yt^fr ///i,)}. . . . (15.31) 

But wh(m this is expanded the term in is — by definition and hence (^) is the 

matrix (e>) of equation (15.20). Thus 


■ ■ ■ f„) = oxp {- mp,^ Oja^tjQ}. 

Furthermore, 

(a) = (A)“> = (to)-^ 

and hence the distribution itself may be written in the form 

For example, with the bivariate form 

1 P, 


d.c„ 


. (1.6.32) 


. (15.33) 
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and hence «> = 1 - p\ Wn oijj == 1, w,, — a>n ==.— /», so that the distribution becomes 
the familiar form 

,JP = - exn J- ^ A- 

2n{l — p*)* ^ \ 2(1 — p®)\ct| Oicr* ff|/J Oi or,' 


15.13. For any fixed a;, . . . ar^, the exponent of (15.33) reduces to the normal 
univariate form in Xi with mean 


-f . . . o, ^p\ .(16.34) 

ani \ 0*2 Us OjJ 

Thus the regression of Xi on the other variates is exactly linear. The variance of Xi in any 

2 

an*av is —^ and the distribution is thus homoscedastic. It follows generally that the 

<nii 

regression of any variate on any or all of the others is linear. Comparing (15.33) with 
(15.21) we see that the distribution may be written 


r]F 


exp 




pts 12 D 


12 \) 


12 


dxy 


dx„ 


(15.35) 


(2jt)‘I(7i . . . CT^ 

where the secondary suffixes in the p and a’s do not, of course, contain r and 

Since every x is normally distributed, every linear function of x is so, as may be seen 
at once from (15.33). In particular the residuals are normally distributed. 

If in (15.33) we make the substitution 


Cl 

C 2 = ^2 1 

^ *^3 21 
Cl ~ »^4 J21 

the exponent will be a quadratic function of the C’s. In this function all product terms 
Ci Cfcj must vanish, for the covariance of C; «'nd Ck vanishes in virtue of the remark at the 
end of 15.4. It follows that the distribution function may be writtem in the form 


dF 


1 

(27r)5r ai (Ts 1 <rs 


21 




dxi da*2 1 . 


(I5.3h) 


From this it appears tlial the joint distribution of any two residuals and x^ ^ is of 
the bivariate normal form with correlation p,j^ Consider, for example, 1 and x^ 21 * 
Each is normally distributed and is uncorrelaled with and independent of the other variables 
in (15.36). If 21 isexpressed in terms of residuals of the second order, i.e. as a ?3 ^ ~^32 i ^2 i» 
the joint distribution of X 2 1 and Xi^ i becomes of the bivariate form with correlation p^^ 1 ; 
and so generally. 

These results are important in the interpretation of regressions and correlations in 
the normal case. In the general case a coefficient such as ^ represents the average 
dependence, so to speak, of Xj and being based on the sum Z{Xf ^ Xj^ ^). In the 
normal case pjj^ ^ is constant for all the sub-populations corresponding to particular assigned 
values of the other variables. 


Sampling Distributions of Partial Correlation and Regression Coefficients 

15.14. We now consider the sampling distributions of the coefficients of partial 
correlation and regression. For large samples the values of Chapter 14 appropriate to 
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ooirelatione aii4 legressione of «ero owier may be (subject to the proviso as to the 
uixreliabiHty of the statidard. error for p unless the sample is very large). For example, the 
variauoe of pjf, ^ in the normal case is given by 

vax(r^fe J . . . .(15.37) 

where n is the sample number; and that of the regression coefficient by 

var (6y*g) .... (15.38) 

The proof of these results by the direct methods of Chapter 9 is a very tedious piece of 
algebra* They follow simply, however, from the remark of the previous section that the 
coritilation beWeen any two deviations ^ and Xj^ ^ is of the normal type with coefficient 
g , for it follows that g is distributed as the correlation between two normal variates. 
Similar considerations apply to the regression coefficients. It will be shown presently 
that if the original distribution was based on n observations, that of p^i^ ^ is of the form 
of the correlation p^j^ based on n — s observations, where s is the number of secondary 
subscripts in q ; but as our equations are only true to order 7i'^^ the divisor in (15.37) 
and (15.38) may remain at n without further error. 


15.15. Consider now the geometrical representation of 15.9. Suppose we have 
three points Q, R, S m the //-fold space, represented by .Ti . . . . . . t/^,, Zi , , . 

respi^ctively, the origin being P and the variables measured from their mean. Then the 
coefficient of correlation Vietween x and y is the cosine of the angle QPR, that between 
y and z the cosine of and that between z and x the cosine of SPR. Now imagine a 
sphere described with unit radius and centre P, cutting PQ, PR and PS in Q\ R\ 8\ Then 
will the partial correlation be the cosine of the angle of the spherical triangle Q'S'R\ 
and so for the other two partial correlations. This was, in effect, proved in 15.10, for the 
angle Q'S'R' is the angle between the projections of PQ and PR upon the space perpen¬ 
dicular to PS. 

Now we may make an orthogonal transformation, corresponding to a rotation of the 
co-ordinate axes, without affecting the correlations ; moreover, if the 7i values of one 
variate x are independent and normally distributed so will be the n values of the trans¬ 
formed variates. Let us then make such a transformation and take PS as one of the new 
co-ordinate axes. It is then apparent that the distribution of r^y which is the cosine 
of an angle in the space perpendicular to PSy is the same m form as tliat of r^y except that, 
being in (r? — 1) dimensions, it is based on (r^ *— 1) independent pairs of normally distributed 
variates instead of n. 

Hence for samples from a normal population the distribution of tlio partial correlation 
coefficient of the first order from 7i sets of observations is the same as that of a correlation 
of ssero order from (w — 1) sets of observations. By a repetition of the same argument 
it follows that the distribution of a correlation coefficient of the 6*th order is that of the 
correlation of zero order from {n — s) sets of observations. The results of the previous 
chapter are thus immediately applicable to partial correlations. If, of course, s is small 
compared with w, the distribution of partials is sensibly the same as that of ordinary correla¬ 
tions, which confirms the approximation of the previous section. 
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The Multiple Correlation Coefficient 

15.16* As in 14.22, the multivariate regression equation can be used to estimate 
the values of one variate from given values of the others ; but in order to see how good 
such as estimate is likely to be we require to know whether the values “ predicted by 
the regression equation are in close relationship to the observed values. Consider the 
regression of Xi on the other variates: 

Xt == ^12 34 p + As 24 p X 9 + . . . 

= p. say*.(15,39) 

If we substitute an observed set of values we shall get a quantity jj, 

say, differing from the observed Xi by the residual quantity Xi 23 p> so that 

- ^1 2? p == 23 p • ' • • (15.40) 

We may then judge of the accuracy of the representation of the observed by the re- 


gression equation by < 

cjorrelating : 

ti and 

2 ) p- 

We have 




23 p) 

= Z{xi - 

■“ 23 

p)“ 





= mol 

- 23 

p) . • • 

. (ir,.41) 

and 


p) 

= 27(a’f) 

- 

21 p) 





mof 

-ol,. 

.) • - ■ 

. (15 42) 

Hence the correlation 

between 

and e 

1p> ^1(2 

„), i« given by 



^ COV {Xi 23 p)^ 

"> (vara-.varf, ,, 

__ ■“ *^1 py 

giving 

Rh p) - 1 ^'23 p.(13 43) 

af 

Rti2 is called the Multiple Correlation Coefficient between Xi and x^ . • . x^^. We 
have, similarly, multiple correlation coefficients of any variate on some or all of the others, 
e.g. Rinay etc 

Two alternative forms of R are worth noticing. Fiom (15.43) and (15,21) we have 

R !(2 p) -- 1 .(15.44) 

Oil 

and from (15 43) and (15.17) 

1 — (I _ i) • • (1 ” Pip I (p-d) • (15.45) 

15.17. From the latter equation it folloAVs that since no p is greater than unity, R 
must be at least as great as the absolute value of any p entering into (15.45). R itself is 
essentially positive, for 0*1 > 33 v (equation (15.18) ). 

It follows that if jR 0 all the constituent p*s must be zero, and conversely. In this 
case Xx is completely uncorrelated with any of the other variates and the regression equation 
is quite useless as a means of estimating the dependent variable. 

On the other hand, if 1 ? = 1 the correlation between the observed and the estimated 
value given by the regression equation is perfect, i.e. x^ is a linear function of the other 
variates. R thus provides a measure of the relationship between Xi and the remaining 
variates. 
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15*18. The coefiftcient R has an interesting geometrical interpretation. It was noted 
in 15.10 that the residual vector PQi ^ ib orthogonal to the space of ( 2 ? — 1) dimen¬ 
sions defined by Py Qi ^ • Qp* C/onsequently the angle between this vector and the 

j)-dimensional space P,Qx , , . Qp is the comfplement of the ang^e P p, that 
is to say its sine is i?i (2 py From this standpoint we see that if /? == 0, PQi is also 
orthogonal to the space P, Q^y . . . Qpy i.e. that Xi is uncorrelated with , x^. If 

jR === 1, PQi lies in the space and Xi is linearly dependent on . . . x^, 

15.19. The coefficient JR, as mentioned in 14-24, is analogous to the correlation 
ratio T], and in fact from some points of view the two are formally identical. Given a set 
of variate-values we may consider the variance of Xi as composed of the sum of two variances, 
for we have, by definition, 

var =r a'i = af - orf 2 /. + 2 „ 

= var (ei 2 p) 4- var (x, — e, 2 p)- • • (1^.46) 

Thus the variance of x may be regarded as the sum of the variances (1) of the deviations 
of from the values given by the regression equation, and (2) of those values themselves. 
We may write (15.46) as 

var (a^i) = OiRi ^2 p) + ^f(l **’ ^h 2 p))* • • (15.47) 

Now consider again equation (14.75) in the form 

var - var x{n\ + 1 - 

4 <^i(l — n\u) .(15.48) 

The relation with (15.47) is evident. It is redeemed from triviality by the fact that, Just 
as the tvo ])arts on the right-hand side of (15.48) are independent in samples from an un- 
corrolated normal population, so are those in (15.47) in samples from a multivariate 
normal population for which the parent R is zero. For in that case Xi is inde|>endent of 
the other variables and therefore deviations of jti from the regression values are independent 
of the deviations of those values about their mean. 


15.20. From this fact we can derive the sampling distribution of JS (the sample 
value of the multiple correlation coefficient) when R (the population value) is zero and the 

(I — JS®) 

population is normal. In fact, as in 14.24, we see that ^ 'is the quotient of two 


independent variables. The numerator is distributed in the Type III form with N — p de¬ 
grees of freedom, for it is a multiple of the variance of x^ 2 i ?> j be distributed 

as the sum of the squares of A" variates about their mean, i.e. with N — 1 degrees of freedom, 
var .Tj 2 with - 2 degrees of freedom, and so on, every additional .sulistTipt lowering 
the degrees of freedom by unity, as in 15.15. Further, the denominator is distributed 
in the Type III form with p — 1 degrees of freedom, for it is the difference of var Xi, which 
has .V ~ 1 degrees, and var Xy ^ ^ which has N p degrees.* Thus the distribution 
of ig formally the same as (14.85) with instead of i.e. is 


dF 




(1 - 


(15.49) 


It is not, of course, true iii general that the difference of two Type 111 variates is distributed 
in the Type III form. In the present case we can find an orthogonal tx’ansformation of tlie variables 
X to new mdt'pendenl normal variables, of which one may be taken to b(' the resKhial ^ j, 



382 


! 


PARTIAL AND MULTIPLE CORRELATION 


This can be reduced tb the 2 -form by writing 

, , JB* N —■ p\ 

— 1, Vj, = iv — p J 

The mean value of is the positive quantity {p — ^)/{N — 1). 

15421. We proceed to find the distribution of jB in samples from a normal multi¬ 
variate population when R is not zero. Two preliminary remarks are necessary. 

In the first place> any multivariate normal population can, by a linear transformation, 
be transformed to new variates which are normally distributed and independent. One 
such transformation has been given in 15.13. 

Secondly, any linear transformation leaves the multiple correlation coefficient in¬ 
variant, that is to say, the coeflSicient between Xi and 3:^ . . . is the same as that between 
Xx and the transformed variables ^2 . . . 1^. Referring to (15.43) we see that, apart 
from the constant <7f, i 2 i (2 p) depends only on erf g and since the regressions are 
chosen so as to minimise this quantity, the same minimum is reached whether we use the 
variables .Tj . . . o-p or the linearly related variables fa . , . fp. Conversely, if the corre¬ 
lation between Xi and f j is a maximum for all possible sets of f’s, then that correlation is 
the multiple correlation coefficient between Xi and the f’s, and Xi is uncorrelated with 
fa . • . fp* 

Prom the geometrical standpoint of 15.10, let US take the sample vectors 7^(>2 . . >PQp 
and in the space defined by these vectors choose another set PS^ • - . PS^ which are 
mutually orthogonal. These will correspemd to the transformed variates f, and the angle 
between PQi and the space remains unaltered, i.e. It is invariant. 

Let us now choose f^ so that the correlation betweem Xi and f^ i^^ ^ maximum in the 
population. Then if PSf is the sample vector corresponding to PQi will be orthogonal 
to all the other vectors PS^ . . . PS^ (since Xi is then independent of fs • • • fp)’ 

In any given sample value the correlation between Xx and f g will not be equal, in general, 
to JR (though the correlation in the population is R), but to a quantity r, say, varying from 
sample to sample and equal to cos ^QiPSz^ Let PT he the vector representing the sampling 

p 

regression formula ^ p Xj. This will lie in the x-i space (cf. Fig. 15.2). Then 


Q. 



Kia. 16 . 2 . 




* n 


it 
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PT is such as to make iUie greatest possible angle with Q^P, the angle being cos‘^ B, and 
the perpendicular from Qt on to the x-i space meets PT in a point, say K. I<et the 
point L be taken on PS, such that LK ia perpendicular to PX and join QiL. Let the 
angle XPZ be y>. 

Then QiL* -= QiP* + Pi/* - 2QrP.PL r 

== + KL* 

= <?,P* - Pi?* + Pi/* - PK^ 

and hence 

_ _ PK PK 

QP.PL QPPL 


— R cos ip. ...... . (15.61) 

R and y are independent 

Now we consider the sampling distribution of the correlation coefficient r. It is to 
be remembered that and <f, are distributed in the bivariate normal form. The distribu¬ 
tion of r is then given by the formulae of 14.14 and may be written 


dF 


Pi 

y/n 1 


m 


(1 - r*)" r dr 


\/n P| 


(I R*\^r _ _ _ 

- l y - « 1 " J_„(co8h2 - 


(15.52) 


since R is the population value of r. If JR 0 the second factor in (15.52) reduces to 
unity. We may therefore regard the second factor as the effect on the frequency density 
in the region dr of a population correlation R. Now we have ali*eady seen that when 
JR = 0 the distribution of R corresponding to that of r is given by (15.49). We have 
then to find by what factor (15.49) is to be multiplied to allow for the variable frequency 
density. Such factor is the second part on the right-hand side of (15.52) with jR cos y; 
substituted for r (as given by (15.51) ) and integrated over the permissible domain of 
It will be seen from Pig. 15.2 that for fixed P and T may vary in the space of (/> ~~ 1) 
dimensions determined by P and . iSp , and for constant yi it will lie on the cone 

in that space obtained by rotating TP about PS^, The element of area cut off by this 
cone on the unit hypersphere is proportional to its solid angle, that is to sin^^~^ ip, and 
hence the frequency of y; in the range dy) is 




\/n P| 


Thus the density factor is 


n-l r» f«> 

p*)— 

Jo J -a 


sin ipdzdf . 
(cosh z — RR cos y;)’ 




(15.53) 

4 


• (15,54) 
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Finally the distribution of R is 


~ „/n - p\ ^(p - 2\ (1 - - R')'^d(R^) 

^ pp fiinv-^rpdzdy) 

J 0 J -00 (cosh z — RR cos y)” ' 

This may be expressed as a hj^pergeometric function. Expanding the integrand in 
powers of cos yj wc have, since odd powers vanish on integration, 


and since 


the integial becomes 


« p + 2/~2 \ sin " V cos y, 

2^\ 2j ) (co8hz)'‘-i+2j' 


j" cos y, sin " - > = ~ 


p dz 

J cosh ” 


V + 2j 
,2 2 


2j - 2 






— 1 7} — I p — \ 
V ’ O" > “■ o » 


jR2jB2 


whence we find, from (15.55), after a little further reduction, 


rfn - 1\ 

dF ^ -\ (1 - {l-i?“)—2- dR^ 




(15.56) 


(15.57) 


15.22. Writing « = l(p — l), h — J(n — p) we have 

dF - (i?*)«-i (1 - R^f-^ F{a + 6, « + 6, o, R^R^) dR» 

/ (a)/ (5) 

" /V)-r(i!,f i *4?*-'* - X 

Ijj;^ may be shown that 

fxm - 1-(1 - fis) F(l, 1, a + 5 + 1, RZ). . 

a + o 

In particular, when R = 0 we have the known result 

_ « _p-l 


Mm 


a + b n — p' 


(15.68) 


. (16.59) 


(15.60) 


. (15.61) 



i 


\ 
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Pot la^rge n we hiaV^ approximately 


Mim 


Or -{• {f> — 

o + b + ^ 


Pot the second moment 


r -fis. 2,« + !■ + 2, K>) 


(ct “1“ ^ "h 


6*(^-«*)* 
'{a + 6)^ 


^**(1, 1, o + 6 + 1, R*) . 


or approximately 
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. (15,63) 


. (15.63) 


. (15.64) 


which, however, breaks down near It 0 . It would, in fact, appear that the distribution 

of R tends to normality when R but not when /t - 0 (cf. Exercise 15.3). 


Example 15.3 

From Example 15.1 we have found w 


0.2448, wu 
0-2448 


0.6864, from which we have 


7?2 — 1 _ 

^i(«3) ^ 0-6864 

0-6433, 


indicating that the regression equation is a fairly close representation of the data, since 
R, the correlation between observed x/s and those provided by the equation, is high, 
about 0.80. 

It is hardly necessary to test the significance of such a value, but we will do so to illus¬ 
trate the arithmetic involved. If were uncorrelated with the other variates we should 
have /i = 0, and on the assumption that the population is normal (a reasonable assumption 
for crop yields, sunshine and rainfall records) we may use equation (15.50). We have, 
since p — 3, n = 20 


z ^ I log^ 


0-0433 17 
0-35()7’ 2 


-- 1-36 
~ 2, 1-2 - 17 

Prom Appendix Table 5 the 1 per cent, significance point of z fo: ~ 2, =:^ 17 is 0-9051, 

so that the observed R is almost certainly significant, s being much greater than can be 
accounted for by sampling alone. 


NOTES AND REFERENCES 

The theory of partial correlation is mainly due to Yule (1907). The reader may refer 
to M. Ezekiel's book (1930) for a detailed discussion of the practical side of correlation 
analysis. See also a paper on the theoretical side by Frisch (1929). 

For a knowledge of the sampling properties of the partial correlations we are indebted 
to Yule (1907), who pointed out the applicability of large sampling ‘‘ normal " formulae 
for coeflSlcients of zero order to the partial coefficients, and to R, A. Fisher (1924), who 
is responsible for the exact result for small samples from a normal population and the 
A.s. oc 
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distribution of the multiple correlation coefficient (1928). Some approximate results for 
the latter had been obtained by Isserlis (1917) and P. Hall (1927). Wishart (1931, 1932) 
has studied the exact distribution of R and the formally equivalent 17 . Both of Fisher’s 
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distributions. 
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EXERCISES 


15.1* 


and that 


Show that 




/?12 34^.p + ^lp.23...(p-n 

1 — Pip 23.. iji-1) Ppl 23.. 


.(P-1) 


P12.34.. (p~l) 


Pl2_34...p + /^lp.23...(p-^l) P2p.l3...(p~l) 
(I — 23.. (p-1))* ^2p.l.3...(p~l))^ 


(Yule, 1907.) 
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zero 


15.2, Show that for p variates there are correlation coejSicients of order 
and ^ order 8. Show further that there are ^ 2 )^^ correlation coefficients 

altogether and regression coefficients. 


15*3. Show that for given pia, p^, paa must lie in the range 

P12 Pi3 ± (1 pf2 pfs + P12 Pis)* 

and that if and Xi and are uiicorrelated no inference can be drawn from that fact 
as to the correlation between and . 1 : 3 . 


15.4* Show that if p^a bo zero, p^^ 3 will not be zero unless at least one of p, 3 , is zero. 

15.5. If the correlations of zero order among a set of variables are all equal to p, 
show that every partial correlation of the .sth order is ^ 


15.6. Show that the distribution of the multiple correlation coefficient B tends, 
in normal samples, for large n, to the form 

dF = \ exp { - - iiS*} 

X 

where ~ p), = R'\n - p). 

In particular, where p = 4, 

dF = {-Uii - m - exp {- + fty)]dB. 

Thus, when ft ^ 0 the distribution of B does not tend to normality, but when ft is not 
zero and is thus large for finite B in distributed approximately normally about ft with 
variance unity. 

(Fisher, 1928.) 


1 2 




1 

l)(2> 


1 ) 2 A 


d(m 


15.7. iShow that the distribution function of R in normal samples may be written, 
if w — jp is even, in the form 

j(« {i-Ry 

(Fisher, 1928.) 



CHAPTER 16 


RANK CORRELATION 

16.1* In previous chapters we have considered the dependence of attributes, as 
measured by coefficients of association, and that of variables as measured (in the normal 
case at least) by product-moment correlation. In this chapter we shall consider a type 
of relationship which, in a sense, occupies an intermediate position between the two, the 
correlation of ranks. 

Consider a set of individuals which can be arranged in order according to some quality, 
such as a set of men according to ability or a set of musical compositions according to the 
degree of preference with which they are regarded by some observer. An ordered anange- 
ment of the objects will be called a ranking and the ordinal number of a given individual 
in the ranking is called his rank. Thus with a ranking of n individuals there will be one 
rank corresponding to each of the n ordinal numbers 1 to 72 . 

16.2. Ranking is less general than the classification of attributes in the sense that 
the division of a population into classes A and not-^, or Ai^ Az , . . Ap, does not require 
any ordering of those classes ; the measures of contingency and association discussed in 
Chapter 13 are invariant under rearrangements of columns or rows in the tables. On the 
other hand, individuals arranged in an ordinary frequency table have their interrelationships 
more closely defined than if they are merely ranked, so that ranking is in a sense more 
general than measurement according to a variate-scale. To put the point in a slightly 
different way, a ranking is invariant under any transformation which stretches the scale 
of measurement of the variate, 

16.3. In practice, ranked data usually arise in two ways :— 

{a) From material which could be measured on a variate-scale but which is not so 
measured for reasons of economy, lack of adequate instruments, and so forth. This class 
includes the case where the data are given as measurements but are then ranked on the 
basis of those measurements in order, for example, to reduce the arithmetical work in 
investigating correlations. 

{b) From material which is believed to be capable of measurement theoretically but 
cannot be measured in practice, e.g. human preferences for food or intelligence. Ranking 
methods are sometimes applied rather uncritically to material which the experimenter 
considers to be capable of ranking, whether it has been demonstrated to be so or not. We 
shall return to this point below. 

It is always possible by suitable conventions to impose a scale of measurement and 
hence a variate-system on ranked material; but the process is sometimes rather artificial 
and we shall in the first instance consider ranked material as such, without reference to 
the possibility of there being any pre-existent or superimposed variate in the background. 

Spmrman*^ Coefficient of Rank Correlation 

16*4. Consider a set of n individuals ranked according to two variables in the orders 
Xi, X 2 , . . . Yi, F, . . , where the X's and the F's are permutations the 
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ttuaibecB 1 to ». Our |»robtem is to dkouss the relationship between the X’s and the F’s. 
If the individnahs are denoted by -4i ... -4* we may write the rankings in the form 

Individual A, ... 

Ranking 1 Xi X, .... (16.1) 

Ranking 2 F, . . , F„J 

We note first of all that the concordance between rankings is perfect if and only if 
Xj == Yj for all j. It is natural to consider the differences Xj ~ Yj(~ dp say) as measuring 
the difference between the two rankings. They are zero if and only if the concordance 
is perfect and their magnitude to some extent reflects the divergence of the rankings from 
perfect concordance. We also note that 


n n ft 


0 , 


(16.2) 




/-I 


1 


for each of the sums of X and Y is the sum of the first n natural numbers. We might 
then take i71 j as a measure of discordance, and a coefficient based on this quantity was in 
fact proposed by Spearman (1906). It is however subject to several disadvantages, similar 
to those attaching to the mean deviation, and a more suitable measure is obtained by 

using X(d^), It is easy to see that the maximum value possible for E{(1^) is ^—~— . 


For 


E{d^) is the greatest if the rf’s are as different as possible, i e if one ranking is the reverse 
of the other, so that the rf’s are (ti — 1), (ti — 3) . . , — (t^ —. 3 ), — (y? ^ 1), though not 
necessarily in that order. In this case 


Ei^jYj) = l(^) 4 2(n - 1) + 3(w - 2) + . . . - 1)} 

l{(n + 1) ^ 1} + 2{(n -f 1) 2} 4 _ , {(n + 1) ^ (n)} 


n n _ 

= (« + 

1 1 /=1 

v{n 4 1)(« + 2) 

6 


(16.3) 


Thus E[d^) - X{X^) 4 X(Y^) - 2E(XY) 


_ n{n 4 1)(271 4"1) -f- I)(w f 2) 

~ ' 3 3 “ 

_ Ji® — n 

~ “3“. 

We then define 

1 „ W*) 

“ — n 


(16.4) 


(16.5) 


as the Spearman coefficient of rank correlation. If the concordance between rankings is 
perfect E(d^) = 0 and p == 1. If the discordance is perfect /j = — 1. In other cases p lies 
between these limits. 
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It is worth noticing that p is the product-moment ooeflftcient of cori'elation between 
X and Y when we regard the ranks as variate-values. For we then have 

// KA ) = =^^+1 . 

^ „ w(M •+ 1)(2 m 4-1) /« -f ly 

n var X — n var I = -',—1 _ ni —^ j 

_ w ® — « 

~ iT . 

n cov (X, Y) = X(XY) - n{^i[(X)y^ 

= - - y)=* -4- x(x^) - 

SO that the product-moment correlation coefficient of X and Y is 




16,5. There is an element of artificiality in the Spearman coefficient as defined which 
we must remove. The ranks are ordinal numbers and cannot without justification be 
operated on by the laws of cardinal arithmetic. For instance, if Ai is ranked 4th and 
8 th by two observers, dt is (4 — 8) ; but what does 4th minus 8th mean, and what signifi¬ 
cance is to be attached to its square ? It is not entirely trivial to note that the necessary 
transition from ordinals to cardinals may be made without invoking a variate-scale. When 
we rank a member as r we mean that in the set of n, {r — 1) members are ranked higher. 
This number (r — 1) is a cardinal and in our particular example 4th minus 8th may be 
regarded as meaning that the difference of the number of members ranked higher by the 
two observers was 4, 

Example 16 J 

Two judges in a beauty contest rank the 10 competitors in the following order : 

6 4 3 1 2 7 9 8 10 5 

416758 10 9 32 

What is the rank correlation ? 

The differences between the ranks are 

2 3-3 - 6 - 3 - 1 - 1 - 1 7 3 

which sum to zero as they should. 

Thus E{d^) ==4*f9 + 9 + 36+ etc. 

= 128 


, (16.6) 

. (16.7) 
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This indicates some sort of concordance between the standards of the two judges, but not 
a very strong concordance. 

Eooample 16.2 

In the previous example there was no information about the real order of the 
competitors, and p merely served to measure the degree of agreement between judges. 
Consider, however, the following case, where an objective order is known : In a test for 
ability to distinguish shades of colour, ten discs were prepared ranging from light to dark 
red, and a subject waa asked to arrange them in order. The true order, as determined by 
a colorimetric method, was 

1, 2, 3, 4, 5, 6, 7, 8, 9, 10. 

The order produced by the subject was 

4, 7, 2, 10, 3, 6, 8, 1, r>, 9. 

What sort of a judge is he ? 

The differences are 

- 3, ~~ 5, 1, - 6, 2, 0, - 1. 7, 4, 1 

and S(d^) == 142, p = 0*139. 

The eoeflficjent is low and we conclude that the observer was a poor judge. 


All AUeruaiive Coefficient 

16.6. A second coefficient of rank correlation which has certain advantages may 
be oblained as follows : Consider again the ranking of the previous example 

472 10 368159 . . . , (16.8) 

Consider the order of the nine pairs of numbers obtained by taking the first number 4 
with each succeeding number. The first pair, 4, 7, is in the correct order (in the sequence 
1 , 2 ,... 10) and we therefore allot it the score + 1. The second pair, 4, 2, is in the wrong 
order and we therefore score — 1. The nine scores will be found to be 

+ 1-1 + 1-1+1 fl-1+1 + 1, totalling + 3. 

Consider next the scores of the second number 7, with its eight succeeding numbers. They 
are 

-1+1-1-1 + 1-1~1+1, totalling - 2. 

Proceeding thus with each number wc find 9 scores as follows :— 

+ 3, — 2, “I 5, — 6, + 3, 0, — 1, + 2, + 1. 

The total of these scores is + 5. 

Now the maximum score obtained if the numbers are all in the objective order 1, 2, 
... 10, is 45. We therefore define the rank correlation coefficient t as the ratio of the 
actual score to the maximum score, i.e., in the present case, 

== 0 . 111 , 

as compared with p — 0*139 for the Spearman coefficient. 

Generally, if there are n individuals the maximum score, obtained if and only if they 
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are in the order (1,2. . . n), is (n — 1) + (n — 2) + , . . + 1 « 
the actual score by S, we have then for the coefficient of rank correlation 

^ n{n — 3) * 


jDenoti)^ 
, (16.9) 


16.7. The actual calculation of 8 may be shortened considerably. Looking again 
at the ranking (16.8) we see that the number 1 has two numbers on its right and seven 
on its left. We therefore score 2 — 7 = ^ 5 and strike out the 1. In the remaining 
ranking, the number 2 has 6 numbers on its right and two on its left, and hence we score 
6 — 2 = + 4 ; we then strike out the 2 and proceed with the 3 as before. It will be found 
that the scores obtained are 


— 5, + + Ij 4“ 6, — 3, 0, + 3, 0, — 1. 

The total of these scores is + 5, and is equal to 8. The rule is quite general. Its validity 
is evident from the consideration that instead of taking each number with its succeeding 
numbers we consider pairs contributing to >9 in a different way. Taking the number 1 
first, and remembering that all other numbers are greater than 1, we sec that any number 
on the left must contribute — I, and any number on the ri^ht + 1, to 8. When 1 is struck 
out the procedure remains valid for 2, and so on. 

Alternatively the following procedure may be adopted. Considering again (16.8), we 
see that the number 4 has on its right 0 greater numbers, the 7 has 3 greater numbers, 
and so on, the numbers being 

6 , 3, 6, 0, 4, 2, 1, 2, 1, 

totalling 26. There must therefore be 45 — 25 = 20 numbers lying to the right of successive 
numbers in the ranking which are less than those numbers, and hence 8 ^ 25 — 20 = 5 as 
before. Generally, if the number obtained by counting greater numbers is k. 


and thus t = - - 1 .(16.10) 

n{n — 1) 

A check may be obtained by counting greater numbers lying to the left. If the total 
of such numbers is I 

a 

2 


T 


= 1 _ 


n(n — 1) 


. (16.11) 


16.8. The extension of the use of t to the case where no objective order is given 
requires a little farther consideration. Suppose we have two rankings as follows :— 

Ax At At At As At A, As At 
P 69435 10' 2187V 

Q 66 10 239741 sj 


. (16.12) 
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T xtt&y be dbinjliedi by a^maging olte mctking in the natural order (1, 2 ... n) thus : 

A* j4.7 A 4 A» A» Ai Aio A» A* 

F' 1 2 S 4‘ 6 6 7 8 9 10 V . . (16.13) 

g' 4 7 2 10 3'6 8 1 6 9j 

and th«» finding r between P' and Q' as in the preceding section. We have however to 
show that if we arrange Q in the natural order, giving 

A» A 4 A» Ag A* Ai At Aie Ag Ag") 

P" 8 3 5 1 9 6 2 7 10 4 V . . (16.14) 

g” 1 2 3 4 5 6 7 8 9 10 J 

then T between P" and g” is the same as that between P' and g'. That this must be so 
may be seen as follows:— 

In (16.13) the successive contributions to S are, as found by the method of 16.6, 

3, "*“ 2j “f“ 3, 0, 1) 2, " 4 “ 1. 

CoriBider now the contributions to S from (I 64 I 4 ) when theshort method of 16.7 is used. They 
will be found to be exactly the same. If the permutation Q' begins with Uo the contribution to 
from pairs involving Uo will be (n — a^) — [a^ — 1 ). In P" the a^th number will be 1 and 
the contribution to will also be {n — Uo) — («© --I)* If the second number in Q* is 
Uj the contribution to will be (ti — Uj) — — 1 ) ± 1 according to whether Ux is 

greater thanc/o or not. In P*' the aitli number will be 2 and the contribution to 8p-* is 
also {n ““ (ii) - (cii - 1 ) ± 1 according to whether 1 lies on the left or the right of 2 in 

P", i.e." wJiether is greater than Uq or not ; and so on. 

In practical calculations it is not necessary to carry out the rearrangements. Consider 
again (16.12). The number 1 in Q has an 8 above it in P. In the ranking of the 8 
has two membei's to the right and seven to the left. Score therefore, — 5, and strike 
out ^48. The number 2 in Q has a 3 above it in P, and has six members to its right (ignoring 
-48) and two to its left, score + 4 ; and so on, the scores being 

5 , 4. 4 , + 1, ^ 0, ~ 3, 0, + 3, 0, - 1 
totalling h which is equal to 8- 

16.9. Like p, t is +1 only if the correspondence between two rankings is perfect 
and ~ 1 only if the rankings are inverted. In actual practice the values given by the 
two coefiicients bear a nearly constant ratio (cf. 16.24) and one appears to be as good as 
the other so far as providing a measure of ranking concordance is concerned, p is, how¬ 
ever, easier to calculate and is probably the most convenient to use. Against this must be 
set certain difficulties in its sampling distribution, which will be referred to below, and the 
fact that r can be generalised to the case of j>artial rank correlations. 

16.10. In considering the interpretation of any particular value of or r the question 
naturally arises, are such values significant in the vstatistical sense, i.e. can they have arisen 
by chance from a population in which the qualities under consideration are independent ? 
And further, can we assign a standard error to the observed values ? The second question 
is not an easy one to answer, or even to understand unless ranks are related to variate- 
values. In the sampling of variates we are given a set of n values emanating from a popu¬ 
lation of values. In the ranking case we are given n ordinal numbers, but it is useless 
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to consider them as emanating from a population of (different) ordinal numbers. The 
point will be considered later when we introduce the concept of grades (16.25). 

The sampling problem, however, acquires a definite meaning if the two qualities under 
consideration are independent. In such a case the pairs of rankings of n members drawn 
at random are independent; and consequently in a large number of samples there will 
occur in equal amounts every ranking according to one quality associated with every 
ranking according to the other. We are thus led to consider the distributions of p and r 
in populations consisting of all possible associations of all possible rankings. Clearly no 
generality is lost if we fix one ranking as the order {1,2 ... n) and consider its correlations 
with the n\ possible permutations of those numbers. If a given p or r cannot, to an accept¬ 
able degree of probability, have arisen from such a population, we are justified in concluding 
that the two qualities have some definite relationship in the population. 

Sampling Distribution of Spearman*s p in the Case of Independence 

16.11. Consider then the distribution of values of p in the population obtained by 
correlating the order (1, 2 . , . ??.) with every possible permutation of the w. natural numbers. 
We shall, in fact, find it more convenient to consider the distribution of Z{d^), which is 
simply related to p by equation (16.6). Certain elementary properties of the distribution 
are obtainable immediately. 

(а) Any value of E(d^) must be even ; for E{d) = 0 and hence the number of odd 
values of d, and thus of d^, is even. 

(б) The possible values of Eid^) range from 0 to 4(?i^ — w) and hence there are 
j^(n® —' yj) + 1 of them. 

(c) The distribution is symmetrical, about a central value if — n) is even, or 
about two adjacent central values if it is odd. This follows from the fact that to any value 
of p corresponding to a permutation P there will correspond a negative value of p, of the 
same absolute value, arising from P inverted. For if P is Xi X 2 . . . the inverted 

n 

permutation is X^, X„_i, . . . X,. E{d^) calculated from P is then ^ (X^ — i)^ and 

t -=1 
n 

that from p inverted is 7 ? + 1 -h ^)^. The sum of these two is 

E{X,^) + E{i^) ~2E(X,i) + E(X,^) + E{7i + 1 - i)^ - 2E {X,{n + 1 - i)}. 

The first, second, fourth and fifth terms in this expression are equal to E{i^), i.e. to ln{n 4 1) 
(27?. + 1). The sum of the third and sixth is 

- 2(77 + 1) E(X) ^ ^n(n + l)^. 

Thus the sum of the two E{d^) is 

f^n{n + 1)(277 4- 1) — n{n + 1)® 

= ^(??^ — n). 

Thus we see from (16.5) that the sum of the corresponding p’s is zero. 

(d) It follows that all odd moments of the distribution of E{d^) about the mean vanish. 

16.12. Consider the deviations between the order 1, 2, . . 77 and an order X. If 

one deviation is known, then certain deviations become impossible for other ranks. For 
instance, if the deviation between Xi and 1 is (77 — 1), then Xj == n, and it is impossible 
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for the deviation between X® and 2 to be — 2); or for the deviation between Xg and 3 
to be (n — 3), and so on. Consider then the array: 


n 
n 
n 

2 1 0 “ . . . - (n 5) 4) (n - 3) 

1 0 -- 1 . . . - (n --- 4) ^ (n - 3) - (/i - 2) 

0 - 1 - 2 . . . — (n - 3) ~ 2) - - 1) 


— 1 n — 2 n — 

— 2 n — 3 n — 4... 

3 71 4 Ti' ■■■*” 5 • • • 


2 1 0 

1 0 — 1 

0 -<1 - 2 


If has the value in the rth row and the kth column, then di cannot have the value in the 
rth row and the Ith column ; and so on. 

In fact, any permissible set of deviations is given by taking n entries from the above 
table so tliat no row or column contributes more than one entry. 

Hence to get £{d^) for any permissible set, write 


a® 



. 

f/'*- 

a’ 



. . . 





. 


.(n ir 




(7® 


and l\d^) is given by the index of a of one of the terms obtained from E by choosing n 
factors so that no row or column appears more than once and multiplying them together. 
Thus the distribution of E{d^) is given by the totality of 7i\ terms which can be constructed 
in that way. E will be taken to be equal to the polynomial in a given by the sum of these 
terms-the so-called ‘‘permanent.” 


16.13. E bears an obvious analogy to the determinant, but it cannot bo regarded 
as such and expanded accordingly. If it could, the distribution of E{d'^) would be obtained 
without difficulty, for a determinant with the elements of E as given above may be shown 
to be equal to 

(1 - (1 - (1 - ... (1 - 

E, in fact, lacks the fundamental property of the determinant in that it does not change 
sign if two rows or columns are interchanged. 

Nevertheless certain of the rules of determinantal algebra remain true for E, The 
most valuable is that E may be expanded in terms of its minors of any order in the usual 
way. Expansion of this type is, in fact, rather easier with E than with the determinant, 
for all terms of E are essentially positive and there are no difficulties with signs. Such 
expansions were used in obtaining the distributions given below. There are also certain 
devices which assist the expansion of E in virtue of its symmetry. Two which will be found 
useful are as follows :— 

(а) Any minor of E is symmetrical in powers of a, i.e. is of the form 

+ A^a^~^ + . . * + A^a'^. 

(б) The effect of shifting a minor bodily across E is to multiply each term of its 
expansion by a constant power of a, 
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TABLE 16.1 

Spearman's p, of £!{d^) for Vaiues of n from 1 to 8. 


Values of n» 



1 

2 

3 

4 

5 

6 7 8 

0 

1 

1 

1 

1 

1 

1 1 1 

2 


1 

2 

3 

4 

5 6 7 

4 



0 

1 

3 

6 10 15 

6 



2 

4 

6 

9 14 22 

S 



1 

2 

7 

16 29 47 

10 




2 

6 

12 26 54 

12 




2 

4 

14 35 70 

14 




4 

10 

24 46 94 

16 




1 

6 

20 56 129 

18 




3 

10 

21 54 124 

20 




1 

6 

23 74 178 

22 





10 

28 70 183 

24 




, 

6 

24 84 237 

26 

* 




10 

34 90 238 

28 





4 

20 78 276 

30 





6 

32 90 264 

32 

• 




7 

42 129 379 

34 





(J 

29 106 349 

36 





3 

29 123 3H0 

38 





4 

42 134 400 j 

40 





1 

32 147 517 

42 






20 98 394 

44 






34 168 542 

46 






24 130 492 

48 

1 

1 





28 175 640 

1 

50 






23 144 557 

52 1 






21 168 666 

54 1 






20 144 595 

56 ‘ 






24 184 776 j 

(m('dian) 

58 j 






14 . 684 

60 ^ 






12 . 786 

62 1 






16 . 718 

64 1 






9 . 022 

66 






6 . 745 

68 






5 . 917 

70 






1 . 781 

72 ’ 






982 

74 






826 

76 






950 

78 






844 

80 






1066 

82 






846 

84 

• 

• 

• 


• 

936 

(median) 

- - - 

— 

— 

— 

— 

- - 

- - - ~ ‘ - - 

Totals 

1 

2 

6 

24 

120 

720 6040* 40,320* 


♦ Total of whole distribution, only the median value and the values 
on one side of the median being shown in this table. 
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TABLE 16.2 

’a p. Probability ihatZ{d^) will be Attained or Exceeded for Values of m from 4 to 8 


inchtsive. 


0 

2 

4 

6 

8 

10 

12 

14 

16 

00 

20 

22 

24 

20 

28 

1 

0*068 

0 833 

0 792 

0 626 

0 642 

0 468 

0 876 

0 208 

0 167 

0 042 






0 002 

0 958 

0 933 

0 883 

0 826 

0 776 

0 742 

0 658 

0 608 

0 626 

0 475 

0 392 

0 342 

0 268 

1 

0 009 

0 992 

0 983 

0 971 

0 949 

0 932 

0 912 

0 879 

0 861 

0 822 

0 790 

0 761 

0 718 

0 671 

1 

1 000 

0 999 

0 997 

0 994 

0 988 

0 983 

0 976 

0 967 

0 966 

0*945 

0 931 

0 917 

0 900 

0 882 

1 

1 000 

1 000 

0 999 

0 999 

0 998 

0 990 

0 996 

0 992 

0 989 

0 986 

0 982 

0 977 

0 971 

0 965 

10 

32 

34 

46 

38 

40 

42 

44 

40 

48 

50 

62 

54 

56 

68 

0 225 

0 175 

0 117 

0 067 

0 042 

0 0‘'83 










0 64 j 

0 599 

0 640 

0 500 

0 400 

0 401 

0 357^ 

0 329 

0 282 

0 249 

0 210 

0 178 

0 149 

0 121 

0 088 

0 867 

0 849 

0 8.!1 

0 802 

0 778 

0 751 

0 722 

0 70 4 

0 669 

0 643 

0 600 

0 580 

0 547 

0 618 

0 482 

0 858 

1 0 962 

j 0 943 

0 934 

0 924 

1 

0 915 

0 902 

0 892 

0 878 1 

0 866 

0 860 

0 837 

0 820 

0 805 

0 786 

00 

1 

1 

64 

60 

' 68 

70 

1 72 

74 

76 

78 

80 

82 

84 

86 

88 

0 068 

0 051 

0 029 

0 017 , 

1 0 0®83 

0 0^14 


1 


i 

1 

1 






0 403 

0 420 

1 

0 391 ; 

j 

0 307 

1 0 HI 

i 0 297 

1 

j 0 278 

1 0 249 

0 222 

[ 0 198 

1 

0 T77 

0 151 

0 1 43 

1 

0 118 

0 100 

0 769 

0 750 

0 732 1 

0 709 

0 690 

0 668 

1 0 048 

i 0 624 

0 603 

1 

0 580 

0 559 

0 533 

0 512 

0 488 

0 407 

90 

92 

94 

06 

08 

j 100 

1 

1 ~ ; 

104 

100 

lOS 

1 

110 

112 

114 

116 

1 118 

0 08 i 

0 069 

0 065 

0 044 

0 033 

j 0 024 

1 0 017 ^ 

1 0 012 

1 

0 0*02 

0 0“34 

1 ~ 

0 oni' 

‘ 0 0*20 



i 

i 

! 0 441 

0 420 

0 397 i 

0 376 : 

0 352 

0 3 12 

0 310 

1 

0 291 

0 268 

1 

1 0 250 

0 231 

0 214 

0 196 

0 180 

0 103 

j 120 : 

122 

124 

126 

1 

128 

130 

132 

134 

130 

138 

140 

142 

I 144 

1 

1 140 

I 1 

148 

1 0 160 

0 134 

0 122 

i 0 108 

I__ __ 

0 098 

0 085 

0 076 

1 

1 

0 060 

0 057 

1 

0 048 

0 042 

0 035 

0 029 

0 023 

0 018 


160 

162 

164 

160 

168 

100 

102 

164 

166 

168 

0 014 

0011 

0 0*77 

OO^'Si 

0 0*36 

0 0*23 ; 

0 0“U 

1 

0 0*67 

1 

0 0^20 

1 

0 0^25 


397 





398 



RANK CORRELATION 

e.g. the minors 


f a® 


a*] 


M = ^ 


a® 

cyl 1 = a® 2a^ + 2a* + 



1 


a«J 


1 



1 

and 

M' = i 


a* 

a® i = + 2a^ + 2a* + a®) 


1 

a« 


a* j 

are related by 






J/' = 


16.14. The tables on pp, 396-7 show the frequencies of for values of n from 1 to 
8 inclusive and the probabilities that a given value of E((l^) will be attained or exceeded 
on random sampling for ii from 4 to 8 inclusive. 

16.15. The distributions of Table 16.1 are i)eculiar in several respects. For lower 
values of n they are distinctly bimodal. For n ===1 and n ^ 8 the frequency polygons have 
an unustial serrated profile, that for the latter being shown in Fig. 16.1, though normality 



Fio. 16.1. Spearman’s p. Frequency Polygon of for n ™ 8. 

is beginning to emerge. It will be shown below that as oo the distribution tends to 
normality, but it is not immediately obvious how a serrated polygon of this kind can do so. 
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I think th?it the tails of the curve smooth out hrst, and that as n increases the smoothness 
runs up the curve towards the apex. 

16.16. The calculation of frequencies for n greater than 8 would be a tedious process 
and can be obviated by finding curves which satisfactorily approximate to the distribution, 
at leaat so far as its distribution function is concerned. For this purpose we will find the 
second and fourth moments of p about its mean. The first and third, of course, are zero. 

Suppose we measure the rank numbers from their mean, writing for the new variables 
x^X + 1), y Y — \{7i + 1). Then from 16.4 we have 


where 


.V 


(n^ 


n° 

n) 


n 


12 


Since E{p) = fi\(p) — 0 we have 


wJiere i 


varp = 

^ \E{E{x^y^)} + -\^E{2:{xtX^y,y^)) . 

-j. Now for any value of x, y may have any value from 1 to >?. Hence 

EE{xhf-) =- nE{x^)E{y^) 


(10.15) 


V 


. (16.16) 


Further, in the product term of (16.15) there are n{n — 1) pairs of values i and thus 

EE(XiX^ y^y^) =- n{n - 1) E^x^x^ y^y^) 

^ n{n — 1) E(x^x^)^ 

1 


n{n — 1) 




^ {(Zxr X(x^)y^ 

71 (n — 1) 

7i{n> — 1) * 

Hence, substituting from (16,16) and (16.17) in (16.15) we have 

1 


(16.17) 


var p 


-+ 7 

71 71 {n 

1 


1 ) 


w — 1 

By the same technique it may be shown that 

3 (25n^ - 3.^ + 72) 

25n(n + l)(w, — 1)® 


(10,18) 


fuip) 


. (16.19) 
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16.17. Consider now the Type II eymmetrio dietributicm 
1 


dF 


s(i. V) 


W- 4 

(1 — z‘) 8 dx, 


1 <x <1 


. ( 16 . 20 ) 


B 


The first and third moments are, of course, zero. The second and fourth are given by 

< 1 - . 


yUa 


/^4 


Xb — I 


— 1 


. (16.21) 


. (16.22) 


The distribution thus has its first three moments the same as those of Spearman^s p in the 
case of independence. The fourth moments are the same to order the difference being 


3 f 25r?3 — 38^2 35 ^ + 721 — 36 

25^(/^ -T)2 j 


i.e. of lower order in 71 than the moments themselves It has therefore been suggested 
that the distribution (16.20) may be used instead of that of p to give the distribution function 
of the latter for moderate or large n. Tests on the distributions of Table 16.1 indicate 
that this is a Justifiable approximation. 

For instance, when n S the distribution (16.20) becomes 


dF 


(I x^)^dx 


B(h 3) 

and by direct integration the probability of obtaining a value of x greater than Xo in absolute 
value is 

1 — ~ Xo 

S\ 


3 ^ 


f)- 


(16.23) 


In comparing this with the values of the p-distribution it is as well to make a continuity 
correction, similar to that of 12.15, to allow for the fact that the distribution of p is dis¬ 
continuous whereas that of x is continuous. If the values of B{d^) are regarded as spread 
over a range of one unit on each side of the actual value, the range of £(d^) is increased from 
}(7i^ — n) to — 7 i) + 2, each terminal contributing a unit. Instead of writing x ^ p 
we will then write 


— n) + 1' 


. (16.24) 


Now from Table 16.2 the probability of obtaining a value of p greater than ^ in absolute 
value, corresponding to S{d^) outside the range 14 to 164 inclusive, is 2 x 0*0053 =: 0*0106. 

14 

The appropriate x from (16.24) is 1 — — = 0*836, and this on substitution in (16.23) gives 

the probability of 0-0098. Similarly the chance of getting a value of S{d^) outside the range 
26 to 142 inclusive is 0-0676. That given by (16.23) is 0-0661. The agreement is evidently 
good enough for most preictical purposes and would, of course, improve as n inoreajses. 



I' u 
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16 . 19 . If w® |mt, in (16,20), 
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we obtain tbe distribution 

dW = 


dt 




(16.25) 


the Student ** distribution of Example 10,6. If n is large the continuity correction may 
be neglected and to this approximation 

X 

so that p may be tested in ‘‘ Student’s ” distribution by writing 

~ 2\l 


t 


/n ~ 2\* 


. (16.26) 


Example 16,3 

In Example 16.2 we found a value of p == 0139. Is this significant ? 
We have 7 t =: 10 and from (16.26) 

8 


t 


- "‘Vi 


(0*139)2 


0*397. 


From Appendix Table 3 we see that the chance of getting such a value or greater in 
absolute value is about 0*70 (== 2(1 — 0*65)). The value cannot therefore be regarded as 
significant. 

16.19. As n tonds to infinity the JS-distribution tends to the normal form and we 
therefore suspect that p also tends to normality. That this is in fact so may be seen as 
follows ; the proof being due to Hotelling and Pabst (1936). 

The general moment of p of even order is given by 


+ . . . .... (16.27) 

n n 

where (8, is written for r ai;id generally Sp for ^ . When the parenthesis is expanded 






we may, in virtue of the independence of x and y, take expectations term by term, regarding 
the cc’s as constant. Now 




n{n — 1) 


etc. 


D D 
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Hence 

+ ‘’‘'I 

where the coefficients A depend on a but not on n. We proceed to show that the term 
of greatest degree in n in (16.28) is the term . . . Xj,^). 

The numerator of any term in (16.28), being a symmetric function of the x’s, can be 
expressed in terms of the symmetric sums 8 p, Further vanishes if p is odd. Since 
any 8 /^ is of degree 4 1 in n, the degree of a aion-vanishing term 8 ^^ 8^^ , 8a^ is 

^^(gj + 1) = 2a + p. Consequently the term of highest degree in n must contain as 

high a p as possible, that is to say as many S*s as possible, subject to the requirement that 
the subscript of each 8 must be even* 

Now consider a term 

. . . Xp^p) 2Vo . . . Sa, ■+■ Zc, 8^^^ ^^8^^ . . . 8^^ 

+ etc. . . (16.29) 

If the a's are all even the term of highest degree on the right is, as just remarked, 
2a 4- p. If the a’s are not all even, suppose there are 7 n even ones and 2q odd ones 
(m + 2 q =p). Then the first term in (16.29) vanishes and the term of highest degree 
which docs not vanish must be obtained by grouping q pairs of odd a’s, and hence is of 
degree 2a + + 9 == 2a + p — 

Now in (16.28) the degree of the denominator in each term is the number of different 
ic’s in the numerator. Thus the term of highest degree in x is of degree 

2(2a 4- p — ^) — (m + 2 q) ^ 4a m -f 2p — 4^ 

= 4a + 

This will be a maximum when m is a maximum and therefore when q is zero, in which case 
m ^ a. Hence the greatest degree in ?? in (16.28) arises from the term Z{x^^ x^^ . . . 
as stated. Now in the expansion of 

(a-i2/i + . . . 

(2aV 

the coefficient of xl . x^ y\ • • • by the multinomial theorem, — and hence 

2* 


I (2«)! {^(xf . 

67- 2- ^ A 


. (16.30) 


The term of highest degree in n in . . . x7) is that in S^’^, the coefficient of which is 
evidently the reciprocal of that of Z(x\ . . . x^) in 

8.r - (xf + ... x7)«, 


Thus, from (16.30), 


2“.a!lw» 


(rt«+i) 
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Now ua ^ - --7 and thus 

^ It — 1 


2«al 


(16.31) 


i.e. to the moments of the normal distribution of unit variance. It follows from the Second 
Limit Theorem of 4.24 that the distribution of p tends to normality. The tendency is not, 
however, very rapid and we have already noticed the peculiar character of the distribution 
for lower n. 


Distribution of r in the Case of Independence 

16.20. We now consider the distribution of the coefficient r under similar conditions, 
that is to say in a population obtained by correlating a given ranking with all the n\ possible 
rankings. 

Consider a given ranking of the numbers 1, 2, ... n and the effect of inserting an 
additional number (n -f 1) in the various possible places in the ranking, from the firstj)lace 
(preceding the first number) to the last place (following the last number). 

Inserting a number at the beginning will add ~~ n to the value of 8 of equation (16.9), 
Inserting it between the first and second will add — (#/ — 2) to 8 ; and so on. Thus to 
any frequency-distribution of 8 for given n, say f{8, n)^ there will correspond frequencies 
f{S — n, n), f(S — (n 2), ri) , . . f{8 f n), the sum of which gives f(Sy + 1), If the 
frequency of a given 8 is the coefficient of in a polj nomial P{x), then the corresponding 
values of 8 in the frequency for (yj -f 1) are the coefficients of 

(r h 4* • • • + + x^)P{x). 

But the frequency-distribution of 8 when n = 2 is given by 4 there being one 

vahie 8 ^ \ and one value /S = 1. Thus the frequencies of 8 for rankings of n are the 

coefficients of x^ in the array 

f =r 4- x){.r‘~'^ 4- 1 4 x'^){x'~'^ -f 4 x^ 4- x'^) . . . (x 4- 

-f . . . -f 4 . . . (16.32) 


It follows that the distribution of 8, and hence that of t, is symmetrical about zero. 
The values of 8 are either all odd or all even, according to whether ^ is odd or even. 

The actual frequencies may be calculated by a figurato triangle, as follows :— 

Frequencies of 


Value of n 
1 
2 

3 

4 

5 


1 

1 

1 

1 

1 


1 

6 

15 


6 

20 


3 

22 


1 

20 


15 9 4 1 


(16.33) 


In this array a number in the rth row is the sum of the r numbers above it and the (r — 1) 
numbers to the left of that number. A little reflection will show that this rule follows 
from (16.32). The formation of the array is quite simple and several devices shorten the 
arithmetic. For instance, in part of the array towards the loft a number in the rth row is 
the sum of the number immediately above it and the number immediately to the left. 
The array is symmetrical and the total in the rth row is r! 
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The following tables show the freqnenoy-distributioa of 8 for values of » from 1 to lO . 
inolusive and the probability that a value of 8 will be attained or exceeded. 

TABLE 16.3 

Bank Coefficient r. DistrUyation of 8 for Valv^e of n from 1 to 10 {only the Positive Half 

of the 8ymmetirical Distribution shoum). 


s 

Values of n 

6 

Valuos of n 

1 

4 

6 

8 

9 

2 

3 

6 

7 

10 

0 

1 

6 

22 

3,836 

29,228 

1 

1 

2 

101 

673 

260,749 

2 


5 

20 

3,736 

28,676 

3 


1 

90 

631 

243,694 

4 


3 

16 

3,460 

27,073 

5 



71 

466 

230.131 

6 


1 

9 

3,017 

2,493 

24,684 

7 



49 

359 

211,089 




4 

21,460 

9 



29 

269 

187,959 

10 



1 

1,940 

17,957 

11 



14 

169 

162,337 

12 




1,416 

14,395 

13 



6 

98 

136,853 

14 




961 

11,021 

15 



1 

49 

110,010 

16 




602 

8,031 

17 




20 

86,064 

18 




343 

6,545 

19 




6 

64,889 

20 




174 

3,606 

21 




1 

47,043 

22 




76 

2,191 

23 





32,683 

24 



1 

1 27 

1,230 

25 




1 

21,670 

26 




7 

628 

27 




I 

13,640 

28 




1 

285 

29 




1 

8,096 

30 




i 

111 

31 





4,489 

2,298 

32 * 




1 

36 

33 


1 



34 ! 




1 

8 

35 


i 

! 

i 

1,068 

36 I 




1 

1 

37 


I 


1 

440 







39 



i 

1 

166 

1 






41 




i 

44 







43 1 





9 

1 

1 

.... ' 

1 

I 





45 1 

J 


„ -1 


1 

1 

1 


16.21. As may be seen by comparing Tables 16.1 and 16.3, the distribution of 8, 
and hence that of t, is much smoother than that of D{d^) and p. We show below that it 
tends to normality, and in fact the tendency is so rapid that for values of n greater than 
10 the normal distribution provides an adequate approximation. We proceed to find the 
second and fourth moment of the distribution. 

If we differentiate the expression / in (16.32) and equate a: to 1 we evidently obtain 

d 

the first moment of 8 ; and generally, writing 0 for the operator 

.(16.34) 

For example, when r =» 1 we have 

»! fii — (— 1 + 1)(1 + 1 4 " 1 ) ... (1 + 1 4 * . . . 4 “ 1 ) 

4- (1 4- 1)(- 2 4- 2){ . . . ) 

4- etc. 


0. 
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TABLE 164 


Pf^abilUy that 8 attains of exceeds a Specified Value, (ShoUm tmly far Positive Values, 

Negative Values obtainable by Symmetry,) 




Values of n 




Values of n 


& 









4 

6 

8 

9 

6 

1 

10 

0 

0-626 

0-692 

0-548 

0-640 

1 

0-600 

0-600 

0-500 

2 

0-376 

0-408 

0 452 

0-460 

3 

0-360 

0-386 

0 431 

4 

0167 

0-242 

0 360 

0-381 

6 

0-286 

0-281 

0*364 

6 

0042 

0-117 

0 274 

0 306 

7 

0-136 

0-191 

0-300 

8 


0-042 

0-199 

0 238 

9 

0-068 

0-U9 

0-242 

10 


0-0*83 

0 138 

0 179 

11 

0-028 

0-068 

0 190 

12 



0-089 

0-130 

13 

0-0*88 

0-036 

0-140 

14 



0054 

0-090 

15 

0-0*14 

0-015 

0 108 

16 



0 031 

0-060 

17 


0 0*64 

0078 

18 



0-016 

0 038 

19 


0-0*14 

0-064 

20 1 



0-0*71 

0 022 

21 j 


0-0*20 

0 036 

22 


1 

0-0*28 

0 012 

23 



0 023 

24 1 


t 

0-0*87 

0-0*63 

26 


1 

0-0*14 

20 1 


1 

0 0*19 

0 0*29 

27 



0-0*83 

28 



0-0*25 

0 0*12 

29 

i 


0-0*46 

30 * 




0 0*43 

31 

1 

1 

! 00*23 

32 ! 

1 

1 


0 0*12 

33 



0-0*11 

34 




0 0«26 

35 



0 0*47 

36 ! 




0 0*28 

37 



0 0*18 

i 





39 



0-0*58 

1 





41 



0-0*16 

t 





43 

i 

, i 

1 0-0*28 

, i 

1_J 

1 

1 



45 


1 ; 

1 0 0*28 

i 


When r = 2 the operation on / will result in two types of terms, those in which both 
operations operate on one factor of / and those in which the operations operate on separate 
factors. When = 1 these last vanish and thus 


«! /-.-(!+ I)^ + (2* 2.)^! + <*■ + “ +/J + *■)»' 


(t? - 1* + »i - . . . + W - 3* + « - l»)nl 

n 


== 5-1* + 0-2* + -Xl^ + 3*) + . . . + -(n 

JU O 4: 71 


1® + » - 3* + . . .) 


This may be summed by the ordinary methods of elementary algebra, and we find 

_ n{n — 1)(2« + 5) 

“ ■ fs 




. (16.36) 


In a like manner it appears that 

== + l±(n - 2) + ~(n - 2)(n - 3) + g(« ~ 2)(n - Z){n - 4) 

+ - 2)(» - 3)(» - 4)(a - 5)| 


. (16.36) 
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16.22. To prove that the distribution, of t tends to normality as »—*• co we shall 
show that 

(2a)!, 


j“2«- 


2 “a! 


(a*.)* 


Consider the effect of operating on/in (16.32) by 0 2a times and then putting x — 1. There 
will appear terms like 

|'^ 2 a _ 2)^® -t . . . + (r — 2)*® + r^®] 

r 


«!/’■ 


_j.2a| 


n! 


r^o-i _ (r — 2)2 «-i ... 4 (r — 2)2« 4r‘‘‘®-n f~ < — (# — 2) 4- . . . (t 4- 2) + f 


'}■ 


etc. Any term with an odd superscript vanishes. Consider now the sum of terms like 




r^] + ... + <2 


fu^ + . . . + u^‘ 

‘ ‘ 1 ^ 


(16.37) 


It will be shown below that this term contributes the greatest power of r? to the sum 
giving n' /zsj,. 

In vh’tue of the multinomial form of Leibniz’ theorem on the differentiation of a product, 
the factor by whi<‘h this term is multiplied in the expansion of is 

- 

21 .. . 2 ^ 2 ^ 


Hence 


{Sum of terms like (16.37)} 


. (16.38) 


Each of these terms is of type {r^ f (r — 2)^ + 


(r — 2)2 n i.e. is of order 


The sum will then tend to the sum of terms like - (12.2^ . . . a^), each term containing 
a squares of the numbers 1, 2 1. Call this 

Then tt* is times the sum of terms in 

a' 


1 


(12 1- 2M . . . W - 12}« 


. (16.39) 


which contain a different factors. 


n 


3a 


Now (16.38) is of order ~ ^ Hence if n,, tends to equality with the sum (16.39) 

y 




'a' 


and hence, from (16.38) 


i«2a 


( 2 «)' (^l^Y 


2 ® a' 

We have tben to show that (16.38) tends asymptotically to the sum of its terms a' n^, i.e, 
that sums of terms like 

1 «.2* ... (a - 1)*, 1«.22 ... (a - 2)2 

tend in comparison to zero. This may be shown inductively. Consider first of all 
{1* + 22 + . . . (n - 1)2}2 271, 4- 1* + 2* 4 ...(«- 1*). 
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The expression on the left ^ -g-. But the sum of fourth powers on the right 
is of lower order. Hence the sum on the right 2^,. We then have 

{1* + 2* + . . . (w - !)*}» ~ 271,(1* 4 1)®} 

^ OjTa 4 terms of type 1*. 2*. 

These terms will be less in sum than 


' which 
o 


2{i* 4- 2* 4- ... (n - + 2* + . . . {n 

TC* ft* 


1 )*} 


which , of degree 8. But the expression on the left is of degree 9. Hence 

O O 

{12 2 * -j- • . , —- 1)^}® ^ 6 :;r 3 , so on. 


We can now justify the assertion that the maximum power of n arises from terms like 
(12.22 . a2). In fact, by a similar line of reasoning to that just given it will appear 

that sums of terms like (1^.22 ... (a — l)^) are of lower degree in n. This completes 
the demonstration. 


16.23. In using the normal distribution to approximate to the ^^-distribution it is 
desirable to make a correction for continuity by subtracting unity (half the interval) from 
S in order to obtain the probability that a given value will be attained or exceeded. For 
instance, uhen /? = 9 we have from (16.35) 


var S 


9^8.23 


= 92. 


The normal deviate corresponding to iS = 20 is then — 1-981. The probability 

of a normal deviate as great as or greater than this is 0*0238. The value from Table 16,4 
is 0 022. Had we made no correction for continuity we should have found a normal deviate 
of 2*085 with a probability of 0*0185. 


Example 16 A 

In 16.6 we found for a certain ranking of 10 , t — 0 *111, ^ = 5. The Spearman 
coefficient for the same ranking, 0*139, has already been seen to be non-significant. What 
conclusion should wo reach about r on this point? 

From Table 16.4 it is seen that the j>robability of a deviation greater than or equal to 
6 is 0*364, and that of a deviation greater than or equal to 5 in absolute value is then 
0*73 approximately. The corresponding value for p is 0*70. In either case the coefficient 
could well have arisen from an “ independent ’’ population and is not significant. 


16.24. Different as p and t are in conception and method of calculation, they are very 
closely related. Cogent reasons (but not a rigorous proof) have been given for belief in the 
validity of the equation (for the population in which all rankings occiu* equally frequently)— 

cov (p, t) = — 

from which the product-moment correlation between p and r is 

2 (n -f 1) _ 1 _ i 

V{2^2?i + 5)}4w 


. (16.40) 
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(Kendal! and others, 1038). For values of n oocurring in practice Hie oonelation between 
p and T is thus very high. It also appears that the regression of p on t is approximately 
linear over the material part of the range, that is, unless both are very close to unity. In 
such a case, recalling the values of the variances of the two coefficients, we shall ^ve 




18w(w — 1) 
4(2n + 5) 


3t 

"" 2 ’ 

so that T will be about two-thirds of the value of p when n is large. 

Orades 

16.25. Up to this point we have considered the problem of rank correlation without 
reference to any variate system which might underlie the rankings. In certain classes of 
inquiry this is inevitable ; for example, we might shuffle a pack of cards and use the rank 
correlation between the orders before and after shuffling to measure the efficacy of the 
process of mixing. The early theory of rank correlation was, however, developed from 
rather a diffiJrent view-point. The qualities considered were measurable, and always in 
theory (and often in practice) it was possible to find a product-moment coefficient of 
correlation. The use of Spearman’s p was regarded as a substitute for such a coefficient, 
suitable either because the necessary ^measurements could not be carried out, whereas the 
ranking could, or because time was saved in working out rank correlations. 

It is not immediately evident what meaning can be attached to ranking in a continuous 
population, for the members thereof are not denumerable. 

The remark of 16.5 offers one way of overcoming the difficulty. The ranking of an 
individual as r can be regarded as a numerical statement to the effect that there are (r - 1) 
members above ” that individual, that is to say (r — 1) members who are given precedence. 
Quantities have already been considered in connection with continuous populations which 
express the same idea, namely, the quantiles. The jpth docile, for example, is the variate- 
value such that p tenths of the total frequency lie below it. We will then define the grade 
of an individual as the proportion of the total frequency with a lower variate-value than 
that borne by that individual. If we have a discontinuous population N in number, the 
grade of an individual ranked according to the variate-values as r (from the lower to the 


higher values) will be 


(rj- 1) 
N 


If the population is continuous its members cannot be 


ranked ; but if we choose a samxfie of n members and rank them, an estimate of the grade 
of the rth member may be obtained by assuming that one-half of that member is to be 
assigned to each of the ranges into which its variate-value divides the variate-range, so that 
its grade is then taken to be 

{(r -l) + i} 


n 


n 


16.26. For a continuous bivariate population there will be no rank correlation, but 
there will, in general, be a grade correlation. CJonsider the bivariate normal population 
whose frequency function is 



i •< 


I 1 I 


SHADES 
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li|r}iW6, to aycid ooniasion with Spearman’s p, w© have denoted the product-moment 
ocwSGioient by p\ 

Jjet 

'1 


e-»-^dar 


0 4 ? 'i rr 

” - r. f-. ’ - V(W) L 


. (16.42) 


Then f and r/ are the grades and if z and y are independent so are f and»/. f is a function 
of z and is distributed in the form 

dF{i) = df, 0 < ^ < 1.(16.43) 

and similarly for rj. Thus the mean and variance of both | and tj are | and y*? respectively. 
For the Spearman coeflSicient between f and rj we may then take 


^QO ^00 

p = 121 I $rj zdxdy . 
J —00 J —00 


. (16.44) 


remembering, however, that this is a generalisation of p to grades. From (16.44) we then 
have 


dp 

dp 


^00 Aoo 

, = 12 hi-dxdy. 

J - QO J OC 


Now 

Thus 


log 2 = — +y^) — I log (1 — - constant. 

2 dp' (1 - ^ ^ ^ ^ i ^ I - p^ 

_ 1 d^z 
z dx dy 


and hence 


dp 

dp' 


By a partial integration with respect to x this is equal to 


The first term vanishes and thus 

dp _ 

dp' ~ 

By a partial integration with respect to y we find 




I o 

J?-*" 




, dy dx 


z dx dy. 


whence, from (16.42) 


12 


dp 

dp* 4jr^(l — p 




(2 — p^)x^ — 2p'zy + (2 — 


2(1 - p'*) 


^dxdy 


6 


n{i - p'*)’ 
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Integrating we have, since p vanishes with p\ 


P 




or 


P 


== 2 sin 


Tip 


. (16.45) 


16.27. This formula is due to K, Pearson, but its value is problematical. It represents 
the relationship between the product-moment and the grade correlations when the variates 
are normal. It has, however, been used to transform a rank correlation obtained from 
a small sample of n values into a putative product-moment coefficient in that sample, or 
even worse, in the population from which the sample is derived, whether normal or not. 
The reader may care to list for himself the assumptions made in adopting such a procedure 
and to reflect on their justification. We shall not notice the process again, but we may 

note that in no case is p very different from 2 sin ^ in numerical value. If /> =; O-O, 
2 sin = 0-618, and this is about the greatest difference that can occur. 


16.28. Equation (16.45) has also been advocated as an easy, though perhaps 
inaccurate, method of calculating a produc1>-moment coefficient. The idea is that when 
a set of bivariate values is given they shall be replaced by ranks, the rank coefficient 
calculated, and the value of p derived from (16.45). Apart from the theoretical objections, 
such a procedure involves no saving of labour if the number of values is greater than 30 or 40. 
Various formulae have been offered for the standard error of an estimate of the parent 
product-moment correlation based on (16.45). Some of those in current statistical text¬ 
books are incorrect, and it may be doubted whether the use of any one is justified. The 
reader may consult Eells (1929) for a list of these formulae. 


Tht of m Rankings 

ua9. We now consider the more general case in which there are m rankings of n 
instead of two. Our problem is to discuss the general agreement among the set of m. 

It is natural in the first instance to consider the average p or t in the possible 

pairs which can be chosen from the set of m. For example, if we have three rankings of 
six as follows : — 


P 5 4 1 6 3 2 

^ 2 3 1 5 6 4 

i? 4 1 6 3 2 5 . . . . (16.46) 

the Spearman p's between PQ, QR and RP respectively are so that the 

average p, say p^^, is equal to — = — 0*26. We shall consider a slightly different 

coefficient linearly related to p^^. 

Suppose we sum the ranks in the columns of (16.46), obtaining the numbers 


11 8 8 14 11 11, 
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These numbers must sum to 63 ^and in general to and reflect the degree of 

resemblance among the rankings. If the concordance were perfect the sums would be 
3, 6, 9, 12, 15, 18, though not necessarily, of cobrse, in that order, and in such a case would 
be as different as possible. On the other hand, when there is little or no resemblance, as 
in the example given, the sums are approximately equal. It is thus natural to take the 
variance of these sums as providing a measure of the ranking concordance. 

Let S be the sum of the squares of deviations from the mean jf 

— n) 


cordanee is perfect the sums are m, 2m, 


nw. and the sum S is 


12 


Write then 


W 


12S 

m\n^ — n)' 


(16.47) 


Then W may vary from 0 to 1 and we shall call it the coefficient of concordance. In the 
above example it will be found that S — 25*5, W = OdO. 


16.30. W is connected with by tlie relation 

7nW — I 

Po« 

In fac*t, if the rankings, measured from the mean J{n + 1), are Xn 
. . . , the average p is 


. (16.48) 


^21 


• • ^2n> 


m{m 


1 12 ^ ^-1 
- lYn^-n Z, 


i 9^ k . 


, (16.49) 


A t’ 1 J -1 


12 


n , tn . n n ti» 

Z Z-.. -ZZv 

y 1 ^ 1 1 '' y — I ? I 


S — W . 


71^ — n 


m{m — l)(/r'^ — n) 

12 

m{in — l)(?r* — ri) 

_ mW ~~ 1 

7)1—1 

is the intra-class correlation for the in sets of ranks considered as variate-values. It 
cannot be less than 

( m -- 1) 


16.31. To test whether an observed value of W is significant it is necessary to consider 
the distribution of W (or, more conveniently, of 8) in the population obtained by permuting 
the 7) ranks in all possible ways in each of the m rankings. No generality is lost in supposing 
one ranking fixed and the others will then give rise to (n!)"^”‘^ values of 8. We will ascertain 
the distributions for some low values of n and m and show how to approximate for larger 
values by the use of a continuous distribution. 
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For the ease m = 2 the distributioa of is that of Z in Table Ib.l. The distributions 
have also been found for «=e3, »» = 2tol0; n»=4, m = 2to6; and » =4 5, m = 8. 
Tables 16.5 to 16.8 give the probabilities based on these distributions in a form analogous 
to Tables 16.2 and 16.4. 


TABLE 16.6 


Concordance Coefficient W. Probability that a given Value of 8 will be Attained or Exceeded 

for n = 3 and Valuee of m from 2 to 10. 


Values of m 


s 

2 

3 

4 

6 

a 


8 

9 ! 

' 1 

10 

0 

1000 

1*000 

1*000 

1*000 

1*000 

1*000 

1*000 

1*000 

1*000 

2 

0*833 

0*944 

0 931 

0 954 

0*956 

0*964 

0*967 

0*971 

0*974 

6 

0*600 

0-628 

0*663 

0*691 

0*740 

0*768 

0 794 

0*814 

0*830 

8 

0167 

0*361 

0*431 

0*522 

0*570 

0*620 

0*654 

0*685 

0*710 

14 


0*194 

0*273 

0*367 

0*430 

0*486 

0 531 

0*569 J 

0*601 

18 


0*028 

0-126 

0*182 

0-262 

0*305 

0 366 

0*398 

0436 

24 



0*069 

0*124 

0*184 

0*237 

0*285 

0*328 

0*368 

26 



0*042 

0*093 

0*142 

0*192 

0 236 

0-278 

0 316 

32 



0*0046 

0 039 

0*072 

0-112 

0*149 

0-187 

0 222 

38 




0*024 

0-062 

0*085 

0*120 

0-164 

0 187 

42 




0*0085 

0*029 

0*051 

0*079 

0 107 

0*135 

50 




OO^TT 

0*012 

0*027 

0 047 

0*069 

0-092 

54 





0*0081 

0 021 

0*038 

0*057 

0078 

56 





0-0056 

0-016 

0*030 

0*048 

0-066 

62 





00017 

0*0084 

0*018 

0*031 

0*046 

72 





00»13 

0*0036 

0*0099 

0*019 

0*030 

74 






0*0027 

0*0080 

0*016 

0-026 

78 





i 

0*0012 

0*0048 

0*010 

0-018 

86 





1 

1 

0*0832 

0*0024 

0*0060 

0012 





1 

1 

f 

00832 

0*0011 

0*0035 1 

0-0075 

98 


1 

1 

j 

1 


0 0*21 

0 0*86 

0*0029 

0-0063 

104 



! 




0*0826 

0*0013 

0 0034 

114 






1 

0 0*61 

0*0^66 1 

i 0-0020 

122 

1 






0*0*61 

00»35 

0-0013 

126 







00*61 

0*0*20 

i 0-0»83 

128 







0 0*30 

00*97 

1 00*61 

134 






i 


00*54 

' 0-0*37 

146 








0*0*11 

0 0*18 

150 




1 


1 


00*11 

0-0*11 

162 

i 


( 

1 


1 


00*11 

0-0*86 

168 




1 




00*11 

0-0*44 

162 




j 




0*0«60 

0-0*20 

168 




1 

! 





0-0*11 

182 




} 

1 





1 0-0*21 

200 




i 

1 





j 00’99 






(v 
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TABLE 16.6 


Concordance Coefficievit W. 


Probability that a given Value of 8 will be Attained or Exceeded 
for n ^ 4 and m = 3 and 5. 


s 

m == 3 

tn ^ 5 

8 

m — 5 

1 

. 1000 

1000 

61 

0-055 

3 

0-958 

0-975 

65 

0-044 

5 

0-910 

0-944 

67 

0-034 

» 

0-727 

0-857 

69 

0-031 

11 

0-608 

0-771 

73 

0-023 

13 

0-524 

0-709 

75 

0-020 

17 

0-446 

0-662 

77 

0-017 

19 

0-342 

0-561 

81 

0-012 

21 

0-300 

0-621 

83 

0-0087 

25 

0-207 

0-445 

85 

0-0067 

27 

0176 

0-408 

89 

0-0055 

29 

0148 

1 0-372 

91 

0-0031 

33 1 

0076 


93 

0-0023 

35 

1 0054 


97 

0-0018 

37 

f 0033 


99 

0-0016 

41 

0017 


101 

0-0014 

43 

0 0017 

0-162 

105 

0-0364 

45 j 

00017 


107 

00»33 

1 49 ' 


0-123 

109 

00«21 

51 ! 



113 

oon 4 

53 1 

1 


117 

1 00 M 8 

57 : 

1 


125 

0 - 0»30 

59 ! 


0-067 


1 

_ 
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TABLE 16.7 

Concordant Coefficient W. Probability that a given Value of 8 will be Attained or Exceeded 

for n — 4 and m = 2, 4 and 6. 


s 

m — 2 

w ~ 4 

1 

m == 6 

S 

m ^ ^ 

0 

1000 

1 -000 

1-000 

82 

0-035 

2 

0-958 

0-992 

0-996 

84 

0-032 

4 

0-833 

0 928 

, 0-957 

86 

0 029 

6 

0-792 

0-900 

0 940 

88 

0 023 

8 

0-626 

0-800 

0 874 

90 

0-022 

10 

0-642 

0-764 

1 0-844 

94 

0-017 

12 

0-458 

0 677 

1 0-789 

96 

0-014 

14 

0 375 

0-649 

I 0-772 

98 

0 013 

1 26 

0-208 

0-524 

0-679 

100 

0-010 

1 18 

0-167 

0-508 

0-668 

102 

0 0096 

1 20 

0 042 

0-432 

0 609 

104 

0-0085 

1 22 


0-389 

0-674 

106 

0-0073 

i 24 


0-355 

0-641 

108 

0-0061 

26 


0-324 

0-612 

110 

0 t )067 

30 


0-242 

0-431 

114 

0-0040 

32 


0-200 

0-386 

116 

0-0033 

34 


0-190 

0-376 

118 

0-0028 

36 


0-168 

0-338 

120 

0-0023 1 

38 


0-141 

0-317 

122 

0-0020 

40 

1 

0-105 

1 0-270 

126 i 

0-0015 

42 


0-094 

i 0-266 

128 1 

i 0 0390 

44 


0-077 

1 0-230 

130 1 

; 0 0387 

46 


0-068 

' 0-218 

132 ! 

0 ona 

48 


0-054 

0 197 

134 i 

1 (1 0366 

60 


0-052 1 

, 0-194 

130 

O-OHO 

m 


0-036 

0-163 

138 j 

0-0336 

64 


0-033 1 

0 155 

140 1 

0 ()328 

66 


0-019 1 

0-127 

j 144 

0-0324 

56 


0-014 f 

0 114 

' 146 1 

0-0322 

62 


0-012 

0-108 

148 i 

0-0312 

64 

1 

0-0069 1 

0-089 

150 

00**95 

66 

! 

1 

0 0062 

0-088 

162 

0-0462 

68 

1 

0-0027 1 

0-073 

154 

0-0446 

70 

! 

0-0027 

0-066 

168 

0-0424 

72 


0-0016 

0-060 

i 160 

0-0416 

74 

1 

1 

0 - 0^94 

0-050 

162 

o-on 2 

76 

t 

00-^94 

0*043 

164 

00®80 

78 

1 

I 

0-0894 

0-041 

170 

00 fi 24 

80 

1 

0 - 0^2 

0-037 

180 

o-on3 
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TABLE 16.8 

Concordance Coefficient W. ProbahilUy that a gimn Value of 8 will be Attained or Exceeded 


for n ^ 5 and m = 3, 


w ~ 3 


m — 3 

0 

1000 

44 

0 236 

2 

1000 

40 

0-213 

4 

0-988 

48 

0-172 

0 

0-972 

50 

0-163 

8 * 

0941 

52 

0-127 

10 

! 0914 

54 

0-117 

12 

1 0-845 

50 

0-096 

14 

0-831 

58 i 

0-080 

10 

0-768 

00 1 

! 0-003 

18 

0-720 

02 

1 0-050 

20 

0-082 

64 

[ 0045 

22 

0 649 

66 

0-038 

24 1 

0-595 

68 

0-028 

20 

0-559 

70 

0-020 1 

28 1 

0-493 

72 

0-017 t 

30 

0-475 

74 1 

0-015 1 

32 

0-432 

76 

0-0078 

34 

0-400 

78 

0-0053 

30 

0-347 

80 

0-0040 

38 

0-320 

82 

0-0028 

40 • 

0-291 

86 

0 0®90 

42 

0 253 

90 ! 

00<09 


16.32. These distributions may be obtained by two methods. The first consists 
of building up the distribution for (m -f 1) and n from that for m and For example, 
with m — 2 and n = 3 we have the following values of the sums of ranks, measured about 
their mean :— 

Typo Frequency 

- 2 0 2 1 

- 2 1 1 2 

- 1 0 1 2 

0 0 0 1 

Here — 2, 1, 1, and 2, — 1, 1 .are taken to be identical types, for tliey give the same 

value of S and will also give similar types when wo proceed to m =- 3 as follows. 

In the case m ~ 3, each of the above type will appear added to the six permutations 
of — ], 0 , I ; e.g. the type — 2, 0 , 2 will give one each of — 3, 0 , 3 ; — 3, 1, 2 ; — 2, — 1, 3 ; 
— 2, 1,1; -1, — 1,2; and — 1, 0, 1. These types are then counted for each of the 

four basic types of m — 2 and we get:— 



Type 

-3 0 3 

^3 1 2 

^2 0 2 

-2 1 1 

- 1 0 1 

0 0 0 


Frequency 

1 

(> 

6 

6 

15 

2 
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The case m == 4 is treated by oonsidering the numbers of types obtaihted by adding 
the six permutaticflis of — 1, 0, 1 to the types for »» = 3; and so on. 

This method is quite convenient for n =s 2 and n *= 3. For w = 4 it becomes difficult 
owing to the labour of oonsidering 24 permutations at each stage and to the increase in 
the number of types. For u = 6 there are 120 permutations and the labour becomes 
excessive. 

The second method is a generalisation of the ^-function of 16.12. For m rank¬ 
ings, the distribution of 8 is given by the expansion of an m-dimensional JP-funotion. 
For example, with = 3 there would be a three-d i mensional JE-function the bottom plane 
of which would be 



3(« + l)l 2 

2 / 

a 


. . a 


.{*■ 

SCti + DI 2 

2 ; 

j 

r 3(n+l)l 2 

L * t . . 

. . a 

[n + 3 + 








The plane above this would be 


f, 3(n+l)'l 2 




and so on. 

The ^/-function is difficult to handle in more than three dimensions, but for the two- 
and three-dimensional case it is manageable and was used to obtain the distribution of 
S for n = 5 and w — 3. 


]6«33. We now proceed to find the first four moments of the distribution of S. The 
method is similar to that used for p but is somewhat more complicated. 

Writing for the deviation from the mean of the Jth member of the ith 

ranking, we have, as in 16.30, 


IT = 1 4- ” i.zi 

m ' m 


Pa/9 


Write 


, 7 n V 

m — n 


n 

^ ^ij ^k} 




i 


( 16 . 60 ) 

(16.51) 


where i, k can have all values from 1 to m and thus any term appears again as 
in the sum Then the moments of W are derivable from thos6 of the Ji's, which 
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fai turn are derivable from those of Spearman's p. In fact, writing N ~ ~ have 

from (16.18) and (16.19) 

EiR^^) = 0, E(R^^o) » 0 'I 


E{R,^^) = NK 


n ~ 1 


(16.52) 


Pin 4 . _ ^ 74 ( 3 ( 25 ^® - 38 »* - 35 « + 72 ) 
E{R^^). ^ I ^(nTiy(» - D* 


We next require the moments of 

but complications arise because in some cases the Jfi’s are correlated among themselves. 
Any two i^'s are independent, i,e. 

m., «/7h) - 0.(16.53) 

unless of course i — I, k == in. This may be seen by reference to (16.51), the x's being 
independent. Similarly 

^i^ik ^Im ^n%)) 

except when we have a set with ‘‘ circular ” suffixes such as 

E{R,j, R,, R,X .(16.54) 

for in tliis case the .r’s (‘ease to be independent. Similarly any four J?*s are independent 
unless tlioy form a set such as 

R,, R,, R„, R^, .(16.55) 

We have 


/ J' \ 

^/ci ^ h ) - ^ 

'»-1 /»-1 , ] ' 

= E I + E x*^(.r,^ x,^ 4 x,^ x,,)} {E x,,. x,^}] 

“= E\{E{y^^^)Ex,„x,^} + E(x^^x^i,){Ex,^x,^ - 2x,„rx,«}] x [2’x,yX„,] 
== -- E{x,,^x^p)} E(Ex,^x,^)^ 

= ^ ^ . 

?i(ri — 1)J n ~ I 


{V ~ 1 )^ 


. (16.56) 


We then have 




m(m — 1 )A 


E { E ( R ,^)} 


. (16.67) 
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w*(wt — l)*jV® 
1 

nt^(m — i )* N ‘ 

1 

«t®(m — l)*iV* 
2 


»>(m - DW ' "'*’" - *>» 
2 1 


ms Rac^ + SR^R^^S R^^ 

iV ® 


m(m — 1) n ~ 1 
^ m»(m - 


m\m — l )^ iV ® 


E E(R^i^ Rj^i 


all other terms vanishing, 


8 w{m 3 )(m — 2 ) 


w®(m — l )® iV ® 

_ S(m - 2) _ 1 _ 

m2(w - 1)2'(7 i -“ly®* 

From these results we have, for the first three moments of W, 

1 


^{^ik ^kl 


fx'i (about 0) = 


m 


ht 


2 ( m - 1 [ 
m^(n — 1 ) 


_ 8 (m - l)(m ^ 2 ) 

m^(n - 1 )* .... 

In a similar way—we omit the lengthy algebra—^it may be shown that 

=. ZJ} - 38w® - 35fi + 72 

ni^{n 1)2 [ 25 ( 71 -® — n) 

+ 2{n - l)(m - 2) + l{n + 3)(m - 2)(m - 3)} , 

16«34* The distribution of W is evidently asymmetrical since /i^ ^ 0 unless 
Consider then the possibility of approximating to the distribution by the Type 

1 




Bijp,q) 

The first two moments of this are 

fi'i (about 0) 




Wv -\ l ~- Wyi -^ dW , 


0 < tr < 1 


p + q 


M 


( 2 > + q)Hp + ? + 1 ) 


f 

1 


( 16 . 68 ) 


(16.39) 

(16 60) 
(16.01) 
(16.62) 

(16.63) 

tn = 2. 
1 form 

(16.64) 


. (16.66) 
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Identifying the values of (10.60), (16.61) and (16.66), we find 

.JLu ^ 1 

P q m 

_pq __ _ 2(j^— 1) 

(P + <lV(P + 2 4- 1) ~ m®(m’— 1) 

giving 

== l (« - 1 ) - " ) 

tn 

q =^{m~ l){i(n - 1 ) - il 


(16.66) 


It will be found that the third moment about the mean of the Type I form is i 

8(m — l)(m — 2) _ 8{w — l){m — 2) r _ 2 T 

m^(n — l)(mn + m — 2) m^(n — 1) \ m{n 1) + 2J 

so that the tliii‘d moments of the IT-distribution and the Type I distribution are approxi¬ 
mately equal if m and n are not small. Similarly the fourth moments will be found to 
differ by a small quantity. We may therefore use the Type I distribution to approximate 
to that of W. It appears likely that as n, m —> oo the distribution of W tends to the Type I 
form, but this has not been rigorously demonstrated. 

16.35. The significance of W can then be tested in the T 3 rpo I distribution, namely, 
by the use of incomplete /^-functions. More conveniently, we may transform (16.64) 
to the form 


dF - k 


. (16.67) 


by the transformation 


( v ^ e ^ 4 * ^ 2 ) 


{m - l)J(ti 


and test in the sj-distribution wliich has been tabulated. 

In making this test it is desirable, for low values of m and to make the usual coirection 

for continuity by subtracting unity from 8 (equation (16.47) ) and increasing the divisor 

- ^ by 2. Let us examine the approximation of the test in some causes wherein 

the exact values are known from Tables 16.5 to 16.8. 

For = 3, m — 9, the 1 per cent, level is given approximately by /S == 78 (Table 16.5). 
For such a value, with continuity corrections, 

w = 0-4696 

81.24 . „ 


0-979 

16 

■ 9 ’ 
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By linear inteipolation of reciprocals in Appendix Table 5 we should require, for complete 
agreement, a value of z equal to 0*954, 

For n = 4, m — 0, the I per cent, point is approximately B = 100. = 8/3, ^ 40/3, 

We have W = 0*5556, z = 0*916. From Table 16.5 we should require a value of 0*893. 

For n = 5, m 3, there is no very convenient value of S close to the 1 per cent, point. 
For P = 0*015, S ^ 74, and for P =- 0*0078, 8 76. 

For >8 = 74 (with continuity corrections) z ^ 1*020 
= 76 ( „ „ „ ) 2: - 1*089. 

By interpolation from the tables z = 1*075. The use of the 2 :-test would lead to the 
correct conclusion that a value of 8 equal to 74 falls below, and that of 76 above, the 
1 per cent, point. 

For values of m ^ndn not included in Tables 16.5 to 10.8 it thus appears that the z-test 
with continuity corrections will give sufficiently accurate results, if n is greater than 3, 
at the 1 per cent, points. It may be presumed that the results at the 5 per cent, points are 
equally good and probably better. But for finer values of significance, such as 0*1 per 
cent., it is doubtful whether the test is sound. The tails of the distribution of 8 for moderate 
values <}{ m and 7i are very irregular. 

16.36. A somewhat more approximate test of W has been given by Friedman (1937), 
who defined a statistic 

= m{7i - l)W .(16,68) 

andshowed that the distribution of tends to that of the Type III as tends to infinity, 
with (« — 1) degrees of freedom. This test appears reasonably satisfactory for moderate 
rn and n, though not so accurate as ours. Friedman has also provided (1949) some 
significance levels of calculated on the basis of the 2 :-te 8 t. 

Example 16.5 

In some experiments in random series a pack oi‘ ordinary playing cards was shuffled 
and the order of the 13 cards of each suit from the top of the pack was noted. The pack 
was then reshuffled and again the orders noted. This was done 28 times. The question 
to discuss was whether the shuffling was good, in the semse that the cards we^re thoroughly 
mixed at each shuffle. 

Here, for each suit, say diamonds, w^e have 28 rankings of 13. I'he sums of ranks 
were 183, 137, 171, 207, 188, 160, 225, 174, 216, 192, 236, 239, 220. The mean is 196, 
and 8 = 11,522 ; W (without continuity corrections, which are not worth making for these 
values of m and ti.) = 0*08075, 2 : == 0*432. This falls just beyond tlie 1 per cent, point. 

Similarly for the clubs W was found to be 0*0535 ; for the hearts, 0*0245 ; and for 
spades, 0*0342. None of these values is significant, and we conclude that the randomisation 
introduced by the shuffling was good, at all events, so far as this test was oonoerned. It 
may be added that the shuffling was done with much more care than would be taken in 
an ordinary game of cards. 

Example 16£ 

In psychological work there has sometimes been a confusion between the determin¬ 
ation of a measure of agreement between subjects and that of an objective order based 
on experimental rankings. It may therefore be as well to point out that in its psycho- 
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logical applications the test of If is one of concordance between jndgmonts. There may 
bo quite a higk measure of agreement about something which is incorrect. 

A number of students were given 12 j^otographs of persons unknown to them, and 
asked to rank them in what they judged from the photographs to be their intelligence. 
For 16 students the sums of ranks were 

112, 94, 101, 84, 97, 76, 104, 84, 102, 146, 125, 124. 

The mean is 104. S == 4472, W == 0*1222. ^ ^ 0*368, and is barely significant, being 

between the 1 per cent, and the 6 per cent, points. 

For 111 students the sums were 

818, 670, 908, 410, 706, 626, 780, 486, 596, 1044, 969, 756 
W = 0*2378, 2 ; -= 1*768, 

This is highly significant and it is to be inferred that community of judgment exists between 
students or groups of students. But there was little relationship between the judgmeiits 
and the intelligence of the photographed subjects as given by the Binet Intelligence Quotient. 

Esiimation of a True Ran km g 

16.37. Suppose we have m sets of n rankings wliich show a significant concordance. 
Assuming that the relations between the rankings reflect the true ranking of the objects, 
how are we to estimate that ranking ? or again, assuming merely a significant concordance 
between observers, what is the ranking “ nearest to their rankings ^ 

An intuitive approach to this problem would probably lead us to this solution : the 
object whose true rank is 1 is that for which the sum of ranks is least; that whose rank 
is 2 is the one for which the sum of ranks is least but one ; and so on. For example, if 
there are three rankings of five objects totalling 9, 7, 4, 10, 15, we should take the third 
as rank 1, the second as 2, the first as 3, the fourth as 4 and the fifth as 5. 

This solution can be given a firmer theoretical basis. It is the “ best ’’ in a least- 
squares sense. In fact, suppose the true ranldng is Xi, Xg . . . X„, where as usual the 
X’s are a permutation of the first w integers. Suppose the sums of ranks are 
Consider the sum 

f7 - ^ mX,)2.(16.09) 

If all the rankings were correct, each would be mX^, so that tliis quantity represents 
in a sense the divergence from complete agreement. Our ‘‘ best estimate of the X*8 
will be given by minimising C7. Now 

U - Z{S^) + X(X,^) - 2m X S, X, 

and since the first two terms are constant we have to maximise the ^S’s being 

given and the X’s the numbers 1 to n. Evidently this will be done by multiplying the 
biggest S by n, the next biggest by (r? — 1), and so on. The result follows. 

There is, of course, an indeterminacy in this method if any two of the aS's are equal. 

Paired Comparisons 

16.38, When the objects which are being ranked are known to be measurable according 
to the quality concerned, no question as to the legitimacy of ranking arises. But eases 
occur in which it is by no means clear that ranking is legitimate, as for instance in the 
arranging of human beings according to intelligence or of pieces of music by human beings 
according to preference. To require an observer to carry out a ranking in such a case 
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tti»y 1)6 eqai]P'a]e]it to askiiig him to mrange Eogiyi towns in of geogmphiofil |>od.iton 
(which is two-dimensional), or a number of fruits according to taste (whic^ is ;probably 
four-dimensional). The ol^nrer may attempt to comply in the full belief that he is doing 
something within his powers, but if the quality under consideration is not measuraWe 
on a linear scale tHe resulting ranking may fail to give either a real picture of his preferences 
or of the variation of the quality in the individuals. For example, in judgments of 
intelligence, it is not impossible that the observer should judge A more intelligmit than 
B, S than O, and C than A , if the individuals are presented for his consideration one pair 
at a time. The likelihood of this happening is obviously increased when we are dealing 
with tastes in music, eatables or film stars ; and in practice the event is not uncommon. 
Such “ inconsistent ” preferences can never appear in ranking, for if d is preferred to B 
and B to C, then A must automatically be ^hown as preferred to C. 


16.39. We therefore consider a more general method of investigating preferences. 
With n objects, we shall suppose that each of the possible pairs is presented to an 
observer and his preference of one member of the pair noted. If the object A is preferred 
to B we write A—>-B or B-*~A. The preferences of a single observer may be repre¬ 


sented in tabular form as shown in Table 16.9. 

In this table, which is shown for the six objects A to F, an entry of unity in column ¥ 
and row X means X—> F, and is thus accompanied by a complementary zero in row Y 
and column X. The diagonals are blocked out. For example, in the table, A—^B, A—*~0, 
D—>A, etc. 


TABLE 16.9 


Tabular Representation of Paired Comparison Schema. 



' 

A 

B 

c 

D 

E 

F 

A 



1 

0 

1 

1 

B 

0 

-- 

0 

1 

i 

0 

C 

0 

1 

— 

1 

1 

1 

D 

1 

0 

! 

0 

i 

0 

0 

- - 

. - 

- 

__ __ _ 

— 

— 


E 

0 

0 


1 

— 

1 

F 

0 i 

1 

1 , 

j 

» i 

i 

I 

? 1 

1 

1 

0 



The arrangement of the objects A to F in the row and column headings is quite arbitrary. 
There are (t*!)® ways of representing the same oonfigqration of preferences in such a table 
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< 

aoOQt^Uijg to |>ev]gQ!tltoiion8 of o^jeots in r«w and ooltuim; i«ifc in practice it ie generally 
desirable to have the ord^ in row and column the same, and even among the n\ possible 
arttogements so given there are often practical oonsid^ations which determine one order 
as more convenient toan others^ 

16.40. Paired comparisons may also be represented geometrically by a method 
which can be illustrated for the case of the six objects as follows:— 

A B 


Fia 16 2 . —CJoomotncal Kopieeentation of tho Scheme of Preferences of Table 16 . 9 , 

We represent the six objects ^ to jP by the six vertices of a regular hexagon and join 
the vertices in all possible ways by straight lines. If we draw an arrow on the line 

AB pointing from A to B. The arrows shown on Pig. 16.2 correspond to the preferences 
shown in Table 16.9. 

16.41. If an observer makes preferences of type A--^B—^C'-^A we say that the triad 
ABC is inconsistent. In the geometrical representation an inconsistent triad is shown 
by a triangle in which all the arrows go round in the same direction. We may thus s})eak 
of a circular ” triad of preferences. In Fig. 16.2 the triads ACDy BEF and three others 
are circular. 

It is also possible to haye inconsistent triads oi^ greater extent ; but any such circuit 
must contain at least two circular triads. Suppose, for instance, that ABCD is circular, 
e.g, that A--->B--^C'-^D—^A . Then either A--^C or (7—. In the first case A CD is circular, 
in the second ABC> Similarly either ABD or BCD is circular. Thus the circular tetrad 
must contain just two circular triads. On the other hand it is possible for a tetrad to 
contain circular triads without being itself circular. 

Similarly, if ABCDE is circular either ABC or ACDE is circular and either BCD or 
BDEA is circular. If the two tetrads are circular there must be at least three circular 
triads (not necessarily four, because ADE may be common to both). It is easy to see 
by an actual example based on this configuration that there need not be more than three 
circular triads ; and it is clear that there must be at least three. For if the tetrads are 
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Bot circular then ABC aBd BCD must be so and then either CDE is circular or ABCE 
is so, adding at least one more. 

Generally, it appears that a circular w-ad must contain at least {n —* 2) circular triads ; 
but it may contain more, and the fact that an n-ad contains {n — 2) circular triads does 
not mean that it is itself circular. In discussing inconsistences, therefore, it seems best 
to confine attention to circular triads, which, so to speak, constitute the inconsistent elements 
of the configuration, and to ignore the more ambiguous criteria associated with circular 
polyads of greater extent. 


16.42* We now prove the following theorems :— 

<^2,3 ___ 7t , 

(1) The maximum possible number of circular triads is - ™ if n is odd and 

" if 71 is even ; and the minimum number is zero. 

24 

(2) These limits can always be attained by some configuration of preferences. 
Consider a polygon of the type ahown in Fig. 16.2 with n vertices. There will be 

(n — 1) lines emanating from each vertex. Let ai, ag, . . oi^ be the number of lines 
at the respective vertices on which the arrows leave the vertex. 


Then 


and the mean value of a,, is 


n 



Define 



(16.70) 


We now show that if the direction of a preference is altered and the effect is to increase 
the number of circular triads by d, T is reduced by 2 ; and conversely. Consider the 

preference A—^B, The only triads affected by altering this to B — >A are those containing 
the line AB. Suppose there are a preferences of type A—^X (including A—>B) and p pre¬ 
ferences of type Then four possible types of triad arise : 

A—^X<—B, say p in number 
A< — X — 

>ii, which must number a — p — 1 
A'^ X"^ B, ,, ,, ^ j). 


When the preference A—^B is reversed the first two remain non-circular. The third 
becomes circular, the fourth ceases to be so. The reduction in the value of T is 


a2 (a 1)2 1)2 

= 2(a /3 - 1) 

=: 2 d, say. 

The increase in the number of circular triads is 

(a - p 1) - - p) a - /9 — 1 

^d. 
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COBFWCIliijT OF CONSISTENOE IN PAmEO COMPABISONS 

M{»e geioerally, if as the result of reversing any number of preferences T is decreased 
by 2 d, i^n d must be an integer and the number of circular triads must be increased by d. 
This cleariy follows fix>m the previotts results, for the reversal of preferences can take place 
one at a time and the effect on T and the number of circular triads is cumulative. 

We now investigate the maximum and minimum values of T. It is clear from the 
definition that T is greatest when the a’s are the natural numbers 1, 2, . . n; and this 

is a possible case because it corresponds to ordinary ranking. Hence max. [T) ^ “-r — . 

12 

For the minimum value, consider the polygon -4a, . . Set up the prefer¬ 
ences . -4^—>-4i. Clearly at any vertex this results in one arrow entering 

and one leaving the vertex, i.e. the contribution to a is unity at each vertex. Next set 
up the preferences -4,—. . . This circuit may either visit each vertex once, 
or not. In the latter case we proceed to an unvisited vertex and set up the preferences 

M Again there will be a unit contribution to all the a’s. 

We then set up the preferences u4i~->-44-~>^7“->, etc., and so on ; and in this way we 
shall ultimately complete the preference scheme. 

If n is odd all the preferences described will consist of circular tours of tlie polygon, 

yj, __ j 

and thus the value of a for each vertex will be - ——. If n is even, the last preference 
will not be a tour but will consist of the single line joining one vertex with the 
symmetrically opposite vertex. Thus here wiU be - vertices for which a = ~ and 

2 JL It 


vortices for which a 


-“ . In this case y = 

2 4 


Now it is clear from the definition of T that it cannot be less than zero, or if n is even, 
be less than - . The configuration just given shows that these minima are^ lH fact, attainable. 

11 ^ ii 

Thus T can vary from a maximum of ----- to a minimum of zero or j. Hence 

the maximum number of circular triads, being half the variation from maximum to minimum 
of T (the maximum of T corresponding to the ranking case in which there are no incon- 

<^^^3 — 4 ^ 2 / _ Ih 

sistences), is if n is even and ~ if n is odd. 

This establishes the two results enunciated at the beginning of this section. 


Coefficient of Consistence in Paired Comparisons 

16.43. Ifd is the number of circular triads in an observed configuration of preferences 
we define 


- 1 


Md 

n^ — n 
2 4cl ^ 


n odd 

n even 


(16.71) 


and call C the coefficient of consistence. If and only if it is unity, there are no inconsistences 
in the configuration, which may therefore be represented by a ranking. As C decreases to 
zero the inconsistence, as measured by the number of circular triads, increases. 

For example, in the configuration of Fig. 16.2 there are five circular triads, ABD^ 
ACD^ AFD, AED and BEF, The maximum possible number is 8. Thus C == 0-375. 
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can also be interpreted in title of Table 16.9. Suppose, in tbat table, we sum 
tibe rows. (The column sums are determined by the row sums and add no fresh information.) 
The sum of any row will be the a-number for that vertex in the polygon which ocnxesponds 
to the object defining the row. T will then be the value of the sum of squares of deviations 

^ -,T - J 

of row totals from the mean value —that is to say, will be the variance pf the row 

sums multiplied by n, t is thus a linear function of this variance ; but it cannot be tested 
in the ^distribution as if Table 16.9 were a contingency table, for the border cells are not 
independent or linearly dependent. 

16«44. If an individual observer produces a configuration of preferences which show 
inconsistence there are usuaDy several explanations ; he may be an incompetent judge, 
the objects may be so alike that consistent differentiation is not possible, or his attention 
may wander during the course of the experiment. We discuss these questions later. They 
are mentioned here to explain ths motive for the next stage of the mathematics. With 
what probability can a value of C arise by chance if the observer allots his preferences at 
random with respect to the quality under consideration ^ 

(f) 

With n objects there are possible configurations of preferences. We proceed to 

( 71 ) 

investigate the distribution of d in this population of 2'^^ different members. The method 
consists of proceeding from the distribution for n to that for {n + 1). 

For 71 *= 3 there ate eight configurations, of which two give one circular triad and six 
no circular triads. (Consider the effect of adding a new vertex I) to the vertices ABC, 
Four oases arise : 

(1) XH->all A, B, C, 

(2) D-^two of J5, 0, 

(3) one of A, B, C, 

(4) D-^none of A, B, G. 

The last two are symmetrical with the first two and need not be separately considered. 
Situation (1) arises in one way and clearly does not add any new circular triads other 
than those already existing in the configuration ABC, It therefore contributes six values 
and two values d = 1. So does situation (4). 

Situation (2) arises in three ways, according as B, or C, The configurations 

Bpiifoached are similar and we may take any one, say C, as the single preference. If 
then DAG is not circular and if B<--C then DBG is not circular On the other hand 
A-^C and B-^^C will each produce a circular triad. We then have the cases 



No. of Circular 
Triads added. 

JL •K'-**' Jti 

0 


1 


i 1 

a^c^b I 

1 2 

i 


We now consider AB, In the first two oases just enumerated the direction of AB 
does not matter and no circular triads are added. With the third A^-^B gives no circular 
triad but A^B adds one. With the fourth A--^B adds one and A<r^B adds none. 





427 


Tiina ihe te^iriW df <5ii:trala^ tdada ocmi:i:!|Kig fQt thm four o&$m is fomid to be 


No. of Circular 
Triads. 

Frequency. 

0 

2 

1 

2 

2 

4 


We must multiply the frequency by three and by two to allow for similar symmetrical 
arrangements, and the final results are 


No. of Circular 
Triads. 


0 

1 

2 


Total 


Frequency. 


24 

16 

24 


64 


Tlie principles of this method are clear enough and the work may be formalised by 
a number of conventions which we omit to save space. In common with matiy similar 
combinatorial problems, however, troubles arise from the sheer number of possibilities and 
the difiiculty of ensuring that nothing is overlooked. Up to the present the distribution 
of d for n up to and including 7 is known. The frequencies and probabilities are given in 
Table 16,10. 


Paired Comparisons for m Observers * Coefficient of Agreement 

16.45, We now consider the investigation of similarities of judgments for m observei’s. 
Suppose that in a table of the form of Table 16.9 we enter a unit in the cell m row X and 
column Y whenever X—vF and count the units in e>ach cell A cell may then contain 

any number from 0 to m. If the observers are in complete agreement there will be cells 

contaming the number m, the remaining cells being zero. The agreement may b© 

complete even if there are inconsistences present. 

Suppose that the cell in row X and column Y contains the number y. Let 

.( 16 - 72 ) 


the summation extending over the n(n — 1) cells of the table (the diagonal cells being 
i^ored). £ is then the sum of the number of agreements between pairs of judges. Put 



. (16.73) 
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TABLE 16.10 

f 

Paired Comparisons, Frequency {f) of Values of d and Probability (P) that Values will 

be Attained or Exceeded. 


Value 

ofd. 



0 

1 

2 

3 

4 
6 
6 
7 
B 
9 

10 

11 

12 

13 

14 


2 ' I-000 


I 


Total! 2 

I 


^ 3 

n 

4 

n 

-r 5 

ri ^ U 


7 

p 

f 

' p 

/ 


f 

P 

/ 

F 

1000 

24 

! 1000 

120 

] 1*000 

720 

1*000 

5,040 

1*000 

0*250 

10 

1 0-625 

120 

0*883 

900 

0*978 

8,400 

0*998 


24 

' 0-375 

240 

i 0*706 

2,240 

0*949 

21,840 

0*994 



1 

240 

1 0*531 

2,880 

0*880 

33,600 

0*983 




280 

1 0*297 

0,240 

0*792 

75,000 

0*967 



1 

1 

24 

1 0 023 

3,048 

0*602 

90,384 

0*931 

1 





8,040 

0*491 

179,700 

0*888 

1 

1 

I ' 

1 



4,800 

0*227 

188,100 

0*802 


! 


1 


2,640 

0*081 

277,200 

0*713 


1 

1 

1 

1 



1 

280,500 

0*580 






i 

t 

384,048 

0*447 


i 

1 

i 




244,100 

0*263 


i 




1 

1 

233,520 

0-147 


1 

1 : 




1 

72,240 

0*036 



f ; 


! 

i 

1 

1 2,040 

0 00 J 

_ 

04 

_ 

1 

1,024 

_ 

1 

32,768 

_ 

, 2 , 097,152 



The maximum number of agreements, occurring 



cells each contain />/, is 



and thus in the case of complete agreement, and only in this case, u — The further we 
go from this case, as measured by agreements between pairs of obtservers, the smaller 

% becomes. The minimum number of agreements occurs when each cell contains 


{m ± 1) 
m IS even or - ^ ~ 


if m is odd. 


That is, if yn is even, the minimum number of agreements i 


and in this case 



(10.74) 


When m is odd the minimum value of u is found to be 

M ^.(16.75) 

m 


16«46. We shall call u the Coefficient of Agreement, It is unity ii' and only if there 
is complete agreement in the comparisons. Its minimum value is not — 1 except when 
m == 2. This, however, is to be expected in a measure of agreement, for there can be no 
such thing as complete disagreement among three or more observers in paired comparisons. 
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If observer P differs in certain comparisons from observers ^ and J?, the two latter must 
agree on those comparisons. 

When m ^ 2, u reduces to ^ 



, ( 16 . 76 ) 


and H becomes twice the number of cases in which the two observers agree about a com¬ 
parison. u is thus a generalisation of a coefficient t. For general r/?, if the entries in the 
table were*, constrained to the ranking tyj)e, u would be the average intercorrelation r between 
observers taken two at a time. 


16.47. In discussing the significance of -w it is desirable to know whether the set of 
preferences which give rise to it could have arisen by chance if the preferences had been 
assigned at random with respect to the quality under consideration. The procedure which 
first suggests itself is a generalisation of the method used for the case of m rankings. That 
is to say, we sum the entries in the rows of the table and consider the variance of these 
entries. If the preferences are allotted at random we expect to find about equal numbers 
given to each object, and the variance will be low ; in other cases it will higher. 

''J'he difficulty about this suggestion is that it has not bc'.en found possible to ascertain 

^ /n \ 

the distribution of the variance in the 2 possible sets of x>reforencos. The case m “ 1, 

corresponding to the distribution of d for inconsistences, is difficult enough to solve. For 
higher values of rn no distributions are known except in trivial cases. 

A test can, however, be devised by using the coefficient u. Consider one cell in the 
table in row X and column V and let it contain the number y. Then the corresponding 
ceil in row Y and column X will contain ni - y. Thus these two contribute to X the amount 

0 ^ r ^ 

Xow, of the total ways in which the units can be distributed in the first cell there 
will be in which y units occur. Consequently the distribution of X in the cell and the 
corresponding cell is given by the expression 


/ 




)'0 



( 10 . 77 ) 


and since the distribution in other pairs of cells is independent if the preferences are allotted 
at random the distribution of X for the whole table is given by 


where N == 



D(X) 


. ( 16 . 78 ) 


16.48. The distributions have been worked out for the following values of and ; 

3 , n = 2 to 8 ; w = 4, = 2 to 6 ; m — 5, ?^ == 2 to 5 ; m = 6, n 2 to 4. 

Tables 16*11 to 16.14 give the probabilities based on these distributions, i.e. the probabilities 
that a given value of X will be attained or exceeded. 
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For oonstaat n the distribution tends to the Type III form as m tends to infinity. 
In fact, for a single pair of related cells the variate-vaJue conesponding to a frequency 

i® ^ 4 . ^0^ which is a quadratic in y. Were the variate-value a Knear function 

of y the distribution for the single cell would tend to normality in accordance with the 
well-known property of the binomial. The case of the quadratic value corresponds to 
a transformation of the variate of the type and the transform of the normal form 

exp(—becomes the Type III form {— y) dy. Since the N cells are 
independent and the sum of variates in the same Type III form is also distributed in that 

form, it fallows that U is in the limit distributed as exp (— £) d£ except perhaps 
for some constants. Thus £ or some multiple of it is distributed as 

For constant m the distribution tends to normality with increasing w. 


TABLE 16.11 

Agreement in Paired Comparisons, The Probability P that a Value of Z toil} be Attained 

or Exceeded^ for m ^ 3^ n ^ 2 to 8. 


n 

2 

n 

- 3 

n 

- 4 

n 

- 5 

n 

-- 6 

1 

n 

- 7 

i n — h 

£ 

P 

2; 

P 

2 : 

P 

Z 


27 

P 

2* 

P 

2 


1 

1 000 

3 

1000 

6 

1 000 

10 

1 000 

15 

1 000 

21 

1 000 

28 

1 000 

3 

0 250 

6 

0 578 

8 

0 822 

12 

0 944 

17 

0 987 

23 

0 998 

30 

1 000 



7 

0 156 

10 

0 466 

14 

0 766 

19 

0 920 

25 

0 981 

32 

0 997 



9 

0 016 

12 

0 169 

16 

0 474 

21 

0 764 

27 

0 926 

34 

0 983 





14 

0 038 

18 

0 224 

23 

0 639 

29 

0 808 

36 

0 945 





16 

0 0046 

20 

0 078 

25 

0 314 

31 

0 633 

38 

0 866 





18 

0 0*24 

22 

0 020 

27 

0 148 

33 

0 433 

40 

0 736 







24 

0 0036 

29 

0 057 

35 

0 266 

42 

0 572 







26 

0 0H2 

31 

0 017 

37 

0 130 

44 

0 400 







28 

0 0«30 

33 

0 0042 

39 

0 066 

46 

0 250 







30 

0 0«»6 

36 

0 0*79 

41 

0 021 

48 

0 138 









37 

0 0*12 

43 

0 0064 

50 

0 068 









39 

0 on2 

45 

0 0017 

52 

0 029 





1 




41 

0 0»92 

47 

0 0*37 

54 

0 011 


* 







43 

0 0^3 

49 

0 0^68 

50 

0 0038 


! 







45 

0 0*93 

51 

OOHO 

68 : 

OOOll 











53 

0-0*12 

60 

0 0*29 









1 


55 

0 0*12 

62 

0 0*66 











67 

0 0*86 

64 

0 0*13 











59 

0 0*44 

66 

0 0*22 


i 




i 

1 





61 

0 01*15 

68 

0 0*32 






[ 


1 



63 

0 01*23 

70 

0 0’40 








! 





1 72 

OOH2 








1 





' 74 

0 0*36 













76 

0 0**24 













78 

0 01113 













80 

0 01*48 













82 

0 01*12 



i 

! 









84 

0 01*14 



16.12 

Aptiommt JMred Thx PmbabUHif P that a Falwe of £ will be Attained 

or Mseimded, f&r m ^ 4 and n »= 2 to 6 {for « = 6 only Values beyond the 1 per cent. Point 


n 

« 2 

n 

«a 

4 

n 

s»» 4 

. 

n 

6 

n 

cat 5 

n 

Te. 

n 

*= 6 

X 

P 

£ 

p 

£ 

P 

H 

P 

S 

P 

£ 

P 


P 

2 

1000 

0 

1000 

12 - 

1*000 

20 

1-000 

42 

0*0048 

57 

0-014 

79 

0 0*42 

3 

0025 

7 

0047 

13 

0-997 

21 

1*000 

43 

0-0030 

68 

0*0092 

80 

0-0*28 

6 

0125 

g 

0-736 

14 

0-975 

22 

0*999 

44 

0*0017 

59 

00058 

81 

00*98 



0 

0 455 

15 

0-901 

23 

0*996 

45 

0-0«73 

60 

0*0037 

82 

0 0*16 



10 

0-330 

16 

0*769 

24 

0*979 

46 

00«41 

61 

0*0022 

83 

oon2 



li 

0-277 

17 • 

0*632 

26 

0*942 

47 

0-0*24 

62 

0-0013 

84 

0-0»»61 



12 

0-137 

18 

0-524 

26 

0-882 

48 

0-0*90 

63 

0*0»76 

86 

0 0“30 



14 

0 043 

19 

0-410 

27 J 

0 805 

49 

00*37 

64 

00»44 

87 

0-01^71 



16 

0025 

20 1 

0 278 

1 28 

0*719 

60 

0*0*25 

65 

00»23 

90 

001*28 



18. 

0-0020 

i 21 ! 

0 185 1 

1 29 

0-621 

51 1 

00*93 

66 

oons 


( 




22 ' 

0-137 

30 

0-614 

52 

00»21 

67 

0-0*72 






1 

' 23 

0-088 

31 

0-413 

53 i 

oon7 

68 

0-0*36 






t 

24 

0-044 

1 32 

0327 

54 

0*0«74 

69 

0-0*18 


! 





26 

0-027 


0 249 

56 

00’66 

, '76 ' 

0-0697 







26 

0 019 

1 

34 

0 179 

67 

0*0’38 

71 

0*0»47 


1 





1 27 

0-0079 

' 35 

0 127 

60 

00*93 

, 72 

0-0620 


1 





1 28 

0-0030 

, 36 

0-090 

! 


i '^3 

0-0610 


1 





29 

1 0-0025 

37 

0 060 

1 

1 


* 74 

0-0*51 


1 





30 

0 0011 

1 38 

0 038 

! 


75 

00*18 


1 

) 





32 

o-ono 

• 39 

0-024 

1 

1 

76 

0-0’78 


1 





! 33 

00«96 

1 40 

0-016 

1 


77 

, 0 0’44 


! 




i 

< 36 

00®38 

t 

i 41 

0 0088 

1 

1 

1 

78 

0-0^15 


1 

t 


TABLE 16.13 

Agreement in Paired Comparisons. The Probability P that a Value of £ wiU be Attained 

or Exceeded, for m — 5 and n = 2 to 5. 


n 

- 2 

n 

- 3 

n 

-- 4 

n 

= 5 

n 

5 

i : 

P 

r 

P 

£ 

P 

£ 

P 

£ 

P 

4 

1-000 

12 

1*000 

24 

1 000 

40 

1 000 

76 

0 0*50 

6 

0*375 

14 

0-756 

26 

0 940 

42 

0-991 

78 

0 0*16 

10 

0*063 

16 

0-390 

28 

0*762 

44 

0 945 

80 

0-0650 



18 

0*207 

30 

0 638 

46 

0 843 

82 

0*0616 



20 

0 103 

32 

0-363 

48 

0*698 

84 

00*39 



22 

0 030 

34 

0-208 

60 

0 537 

86 

oono 



24 

0*011 

36 

0-107 

62 

0*384 

88 

00’23 


1 ] 

1 26 

0*0039 1 

38 

0*063 

54 

0 264 

90 

0 - 0«53 



30 

00*24 

40 

0*024 

66 

0-168 

92 

0 * 0*12 





42 

0-0093 

68 

0-092 i 

94 

0 * 0*14 



1 


44 

0 0036 

60 

0-050 

96 

0 * 0 iH 6 





46 

0-0012 

62 

1 0-026 

100 

0 * 0 i ®91 





48 

0-0636 

64 

0*012 




j 

1 


50 

0 0*12 

66 

0-0067 







1 52 

0 - 0*28 

68 

0-0026 







54 

0*0664 

70 

0*0010 







56 

0*0618 

72 

0*0639 







60 

L - - 

0 * 0’60 

74 

00*14 
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TABLE 16.14 

Agreement in Paired Comparimns, The Probability P tJ^at a Value of S will be Attained 

or Exceeded^ for m ^ 6 and n ^ 2 to 4. 


n 

2 

n 

3 

n 

- 4 

n 

4 

n 

4 

£ 

P 

£ 

P 

V 

P 

£ 

p 

s 

P 

6 

1000 

18 

1000 

36 

1-000 

55 

0-043 

74 

00^2 

7 

0-688 

19 

0-969 

37 

0-999 

56 

0-029 

75 

0 - 0»89 

10 

0 219 

20 

0 833 

38 

0 991 

57 . 

0-020 

76 

00 H 9 

15 

0031 

21 

0 026 

39 

0-969 

58 

0-016 

77 

0-0632 



22 

0-623 

40 

0 806 

59 

OOll 

80 

00«08 



23 

0-468 

41 

0-822 

60 

00072 

81 

oon7 



24 

0 303 

42 

0 7.55 

61 

0-0049 

82 

oon 2 



26 

0-180 

1 43 

1 0-669 1 

‘ 62 

0-0034 ! 

85 

0 - 0’34 



27 

i 0 147 

1 

1 0-.556 

63 

' 0-0026 

90 

00»93 



28 

i 0-088 

, 45 

0-466 

64 

1 0-0016 , 





29 

0-061 

1 46 

1 0-409 ' 

65 

0 0»83 1 

i 




30 

0-040 

1 *17 

! 0 337 

66 

; 0 - 0*66 

1 




31 

0 034 ; 

48 i 

1 0 257 1 

67 1 

0 0*48 1 




1 

1 

32 1 

0023 

49 

0-209 I 

68 

0 0*26 

1 

j 



i 

35 1 

00062 ' 

50 1 

1 0-175 ' 

69 . 

0<)-*10 




i 

36 1 

0 0029 i 

i 51 ' 

0 133 1 

70 , 

0 - 0*86 

I 



1 

37 ’ 

0-0020 ' 

52 ! 

0-097 1 

71 

0 - 0*68 1 

1 




40 1 

0 - 0^58 

53 

0-073 

72 1 

0 0*48 

1 



i 1 

: ) 

1 

45 1 

1 

0 0 \ 3 ] i 

1 

54 

0 057 

73 

1 

0 - 0*16 

1 



1 

__ 



1 

1 



1 

^ _____ 


1(»,49. The first of these results suggests that the Type III distribution will provide 
an approximation to the distribution (16.78) when vi is moderately large. We proceed to 
find the first four moments of (16.78). 

It is sufficient to find the first four moments of (16.77), those of (16.78) being obtainable 
therefrom in vittue of the relationships which connect cumulants of independent distributions. 
The rth moment of (16.77) about the origin is given by 

. 

since T** is the total frequency. Thus we have 




mr 4 


— 


+ 2:(^y^ - mr) . (16.80) 
Sums such as 27 can be obtained by operating on the binomial (1 + x)”‘p times 


d 

by e.g. we find 






V 
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and hence, substituting in (16.80), 

^ 1 ( 2 )' 

Thus the mean of the distribution (16.78) is given by 

In a similar way we find 




(16.81) 




i<“). 


(16.82) 


157y# 

8 


17 


4- ^\N(7n^ — m) 


These are the moments of E. Those of are obtained by dividing by an appropriate 
power of and it may bo noted in particular that the mean of u is zero, 

16.50. The first four moments of the Tj^pe III distribution 

dF ^ ke dx 


an" 


q q 2q t^q(q 4 2) 


P^ 




Equating the second and third moments to those given by (16.82) we find 

Nrtiitn -- 1) ^ 

^ 2(w 2)^ 


P ^ 




(16.83) 


To make the first moments correspond wo move the origin of tlie 2’-disiribution a distance 
- 3 
fm 

coinciding in tiie first three moments. 


*) right. Wo thus reach the approximation to the 2’-’distribution, 


dF — Ke fff 


N 711 Oft » 
^ j e 


dx, 


where 



or, transforming to the more usual form by putting x^ 


4 .r 

VI 2’ 


we find that 


is distributed as x^ with 



- 

"Y"' -“V-'* 

1 

• \2 

5 Jrn — 2 Jm - 


Nm{vi ~ 1) 
{m - 2)2 


(16.84) 


(16.85) 


degrees of freedom. 

The fourth moments of E and the x^ approximation differ by terms of order N and 
compared with their absolute values. 
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1^*51/ It only remains to bo seen bow large m and n most be for this to provide 
a satisfactory approximation* 

Consider first the distributions for m « 3. When n = 8, iV* =« 28, we have, for the 
approximation, 4cZ distributed with 168 degrees of freedom. From Table 16.11 we see 
that for S === 64, P « 0-011 and for 2* == 68, P 0-0011. Applying a continuity correction 
by deducting unity from 2 we find for the approximation with 4 x 63, v =« 168, 
p = 0-011, and with ^ 4: x 67, P = 0-00114. The correspondence is very close, in 
spite of the low value of m. 

For m ~ 4, w == 5, N ^ 10, the approximation gives 22 — 30 distributed with 
30 degrees of freedom. For 2 = 40 and 41, this gives, with continuity corrections of 0*6, 
half the variate-interval, x^ = 49 and 51, r — 30. From the diagram at the end it is seen 
that these values lie one on either side of the 1 per cent, value ; and this is in accordance 
with the exact values of P, which are seen from Table 16.12 to be 0 016 and 0-0088. Similarly 
we find that the values of 2, 37 and 38, lie on either side of the 5 per cent, level, which is 
again in accordance with the exact values, P == 0 060 and 0-038. 

.For -m == 6, n ^ 4^ iVT = 6, the approximation gives 2 — 33-76 distributed with 
11-25 degrees of freedom. For 2 = 69 and 60 the corresponding values are seen to 
lie on either side of the 1 per cent, point, which accords with the exact value of Table 16.14. 

We conclude that the x^ approximation provides an adequate test of significance for 
the values of m and 7x outside the range for which Tables 16.13 and 16.14 give exact values. 

ExamjgU 16,7 

A class of boys (ages 11 to 13 inclusive) were asked to state their preferences with 
respect to certain school subjects. Each child was given a sheet on which were written 
the pbssible pairs of subjects and asked to underline the one preferred in each case. The 
results were as follows : 

21 boys, 13 school subjects. The preferences are shown in Table 16.15, winch is in 
the form described in 16.39 ; e.g. there were 18 boys who preferred Art to Religion. 


TABLE 16.15 

Preferences^ of 21 Boys in 13 8vl)ject8. 



1 

2 

3 

4 

5 

0 

7 

8 

9 

10 

11 

12 

13 

Totals 

1. WoodA^oik 


14 

20 

15 

16 

16 

16 

18 

18 

18 

20 

21 

1 

20 

1 

211 

2. Gyrrumstjcs 

7 


14 

12 

13 

18 

14 

16 

16 

20 

16 

18 

19 

! 3 83 

3. Art 

1 

7 

- 

10 

14 

10 

16 

18 

16 

16 

17 

16 

19 

i 160 

4. Bcienco 

6 

9 

11 

— 

11 

12 

15 

14 

13 

13 

17 

17 

16 

154 

5. History 

6 

8 

7 

10 

— 

14 

11 

12 

14 

15 

13 

14 

16 

140 

6, Goograj)hy 

5 

3 

11 

9 

7 


14 

14 

13 

13 

16 

16 

17 

137 

7. Arithmetic 

o 

7 

5 

6 

10 

7 

— 

9 

11 

13 

15 

13 

15 j 

116 

S. Keligion 

3 

5 

3 

7 

9 

7 

12 

— 

12 

14 

14 

16 

14 I 

116 

9. English Literatnrt^ i 

3 

5 

5 

8 

7 

8 

10 

9 

— 

10 

13 

13 

16 ! 

100 

10. Commercial subjects 

3 

1 

5 

8 

6 

8 

8 

7 

11 


10 

10 

14 1 

91 

11. Algebra 

1 

5 

4 

4 

8 

5 

6 

7 

8 

11 

— 

10 

13 1 

82 

12. English Grammar 

0 

3 

5 

4 

7 

6 

8 

5 

8 

11 

11 

— 

13 

81 

13. Geometry 

1 

2 

2 

5 

5 

4 

6 

7 

6 

7 

8 

» 8 

— 

61 













Total 

1638 
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The oal«rti]»tion of S for this table, in which the objects are arranged in order of total 
number of prefarenoea, may be shortened by noting that E, as given by equation (16.72), 
may be tramdormed into the form , 

where the summation now takes place over the half of the table below the diagonal. Since 
the numbers in this half are smaller than those in the other half there is a considerable 
saving in arithmetic, 

We find 2" = 9718 


and hence 


__ 2 X 9718 


1 0 186. 


There is thus a certain amount of agreement among the cliildren, indicated by the 
positive value of u. Is this significant ^ 

We note first of all that tliis distribution of preferences could not have arisen by cliance 
to any acceptable degree of probability. In fact, ~ 412-4 (equation 16.84)) and v — 90-7. 
The large value of v justifies the use of the normal approximation to the ;f*-distribution 
and we find '\/(%*) — '\/(2»’ - 1) — 1”>‘3, a very improbable result on the hypothesis of 
a random allocation of preferences. 

The distribution of circular triads was as follows 


No of Triads. 

1 

Frequency 

No of Triads. 

I Frequency. 

0 

1 

12 

1 1 

1 

3 

17 

3 

4 

6 

21 

J 

i 

2 

25 

1 

7 i 

2 

29 

1 

8 

1 

39 

1 

10 1 

1 

1 

Total 

__ 1 

1 

__ 1 


The total number of circular triads was 242 with a mean of 11-5. Only one boy was 
entirely consistent. On the other hand, for « = 13 the maximum number of circular 
triads is 91, with a mathematical expectation of 71-5. It is thus clear that, except perhaps 
for one boy, we cannot suppose that any boy allotted preferences at random. We are 
again led to conclude that the boys are genuinely capable of making distinctions, and that 
consistently on the whole. Half the boys have coefficients of consistence C greater than 0-92, 
We conclude that the boys can make preferences and that in their view the subjects 
are sufficiently different to enable a reasonably consistent set of preferences to be made. 
So far as these data are concerned there would be no objection to the assumption that 
a scale of preferences can be set up. With this in mind, we can say that the value of 
n indicates a certain amount of agreement, though not a strong one, between the boys as 
to which subjects they prefer. 
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NOTES AND REFERENCES 

Spearman has suggested another coefficient of rank correlation, viz. 

- r 

but this “footrule” is unreliable as a measure of dependence—it cannot, for example, 
attain — 1. For earlier work on rank correlation see Spearman (1904, 1906), K. Pearson 
(1907) and “ Student ” (1921). The distribution of p in the case of independence was 
given by Kendall and others (1939). Pitman (1937) had previously suggested that it 
could be approximately represented by the R-distribution. 

The coefficient t was suggested by Kendall in 1938. In practice p is probably more 
convenient. It is, however, re)narkable that t is unique among correlation coefficients in 
depending only on linear processes, so that machines may be constructed to calculate it. 
Furthermore, t can be ada])tod to give partial rank correlation coefficients (Kendall, 1942). 

The problem of m rankings was considered bj' Friedman in 1937 and by Babington 
Smith and Kendall and by Wallis in 1939. Friedman (1940) has reviewed this work and 
provided some useful tables based on the Type I approximative distribution. Wallis has 
pointed out that the coefficient IF is the ranking analogue of the coirelation ratio. Kelley 
(Statistical Method) had considered as a measure of concordance in rankings. 
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EXERCISE^ 

16.1. Show that the coefficients of rank correlation p between the natural order 1, 
... 10 and the following rankings are ~ 0-37 and + 0-45 respectively. 

7, 10, 4, 1, 6, 8, 9, 5, 2, 3 ; 

10, 1, 2, 3, 4, 5, 6, 7, 8, 9. 

Show that the corresponding value.«i of r are — 0-24 and + 0-60. 

16 . 2 . Defining 

Xr^ “ m(w — 1) IF 

show that approximately Xr^ is distributed as x^ iii the Type HI form with v -- 7i~I 
degrees of freedom. 

(Friedman, 1937.) 


16.3. Show that W is the ratio of the sum of squares between columns and the total 
sum of squares (the rankings being regarded as arrayed one below the other) and hence 
that W is the s(juare of the correlation ratio r)yj for auch an array (the ranks being regarded 
as variate-value.s). The “ sum of squares between columns ” means the sum of squaios 
of deviations of column means from their mean. 

(Wallis, 1939.) 

16.4. Show that Spearman’s “ foot-rule ” 


can attain, but not exceed, the value 1. and can be as small as, but not smaller than. — 


16.5. Verify formula (16.63)., 


16.6. The following table shows the prefercncr's of 2.'> girls in 11 school subjects. 



1 

2 

3 

4 

5 

0 

7 

8 

9 

10 

11 

Totai-s 

1 

1. Gymnastics j 


10 

19 

17 

20 

17 

21 

21 

21 

18 

22 

180 

2. Science ] 

15 

— 

12 

15 

17 

15 

21 

19 

18 

10 

1 

105 

3. Art 

(i 

13 

— 

10 

l() 

18 

10 

17 

10 

19 

itt' 

147 

4. Domestic Science 

8 

10 

9 

__ 

10 

J1 

13 

15 

14 

11 

14 , 

121 

5. History 

5 

8 

9 

9 


14 

18 

12 

13 

15 

18 

121 

6, Arithmetic 

8 

10 

7 

14 

J1 

— 

12 

13 

12 

10 

18 1 

121 

7. Geography 

4 

4 

15 

12 

7 

13 

— 

14 

15 

14 

14 1 

112 

8. English Literature 

i 4 

() 

8 

10 

13 

12 

11 


14 

13 

14 ' 

105 

9. Religion 

1 4 

7 

9 

11 

12 

13 

U) 

11 


11 

17 1 

105 

10, Algebra 

1 7 

9 

0 

J4 

10 

9 

11 

12 

14 


12 j 

104 

11. English Grammar 

3 

8 

9 

]] 

7 

7 

11 

11 

8 

13 

_ 1 

t 

1 

88 











Totai. 

i 

1375 


Show that the coefficient of agreement u is 0-082 ; that this is significant; but that 
the girls are less alike in preferences than the boys of Example 16.7. 




APPENDIX TABLES 


APPENDIX TABLE 1 

Normal Distritmtion. Frequency Function of the Normal Distribution at every Tmth of the 
Standard Deviation, with First and Second Differences. The value of the centred ordinate 
at zero is l/V2n. 


IT 

y- 

1 

j ‘iH-y 

AK 

X 

y- 

dM-). 

A*. 

(T 




a 




00 

0 39894 

j 

' 199 

- 392 

25 

0 01763 

395 

+ 79 

01 

0*39695 

' 691 

- 374 

2*6 

001358 

316 

4* 60 

0-2 

0.39104 

965 

- 347 

2*7 

0*01042 

260 

4- 63 

0-3 

0*38139 

' 1312 

- 308 

2*8 

0 00702 

197 

+ 46 

04 

0 36827 

) 1620 

- 265 

29 

0 00596 

152 

+ 36 

06 

0.35207 

1885 

212 

30 

0*00443 

116 

+ 27 

00 

0 33322 

2097 

-- 159 

3 1 

0*00327 

89 

4> 23 

0*7 

0*31225 

2256 

- 104 

3*2 

0*00238 

66 

+ 17 

0-8 

0 28969 

2360 

- 52 

3 3 

0*00172 

49 

+ 13 

09 

0 26609 

2412 

0 

3*4 

0 00123 

36 

4“ 10 

1 0 

0 24197 

2412 

i* 46 

36 

0*00087 

26 

+ 7 

11 1 

0*21786 

2366 

1 84 

3 6 

0 00061 

1 

i + 6 

1-2 , 

0*19419 

2282 

+ 118 

37 j 

1 0 00042 

13 

i + 4 

13 

0*17137 

2164 

-f 143 

38 1 

1 0 00029 

1 9 

1 + 2 

1-4 1 

0*14973 

2021 

*f 161 

39 

1 0 00020 

7 

+ 3 

! 

1*5 

0*12952 

1860 

4- 173 

40 , 

0 00013 , 

4 


1*6 

0*11092 

1687 

4- 177 

4*1 i 

0 00009 


— 

1 7 

0 09406 

1510 

4- 177 

4 2 j 

0 00006 

I 2 


1*8 

0 07895 

1333 

4- 170 

4 3 

0*00004 

2 

1 - 

1.9 , 

0*06562 

1 1163 

~t 162 

44 

0 00002 j 

— 

i 

2-0 j 

0*06399 

, 1001 

+ 150 

4 5 

0 00002 1 

__ j 


2-1 

0 04398 

1 851 

f 137 

4 6 

0 00001 

— 1 

— 

22 , 

0*03547 

714 

^ 120 

47 

0 00001 , 

.— 

, - 

23 ' 

0*02833 

694 

-h 108 

48 

0 00000 1 

— 

_ 

24 j 

0*02239 

486 

i 1 

f 91 


1 

1 



Precision of Interpolation .—Owing to the magnitude of the second differences, simple interpolation 
near the beginning of the table may give an error up to 6 in the fourth place; the use of second 
differences will bring this down to 1 or 2 in the last place, third differences being small. Where third 
differences are greatest, in the neighbourhood of x/a = 0"6, the error may be as large as 3 in the last 
place imless the third difference is used. 
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APPENDIX TABLE 2 

Nmnud Dtsiribufimi, The Distribution Function F of the Normal Distribution^ tabulated ut 
every Tenth of the Standard Deviation, with First and Second Differences. 


a* 



/!•(-)• 

JL 

a' 

F. 

^H + ). 

/!»(-). 

a 



00 

0 60000 

3983 

40 

2 5 

0 99379 

155 

36 

01 

0 53983 

3943 

78 

26 

0 99534 

119 

28 

02 

0 67926 

3865 

114 

27 

0 99653 

91 

22 

03 

0-61791 

3751 

147 

2 8 

0 99744 

69 

17 

04 

0 66542 

3604 

175 

29 

0 99813 

52 

14 

0 5 

0 69146 

3429 

200 

30 

0 99865 

38 

10 

0 6 

0 72575 

3229 

219 

3 1 

0 99903 

28 

7 

0 7 

0 76804 

3010 

230 

32 

0 99931 

21 

7 

0 h 

0 78814 

2780 

240 

33 

0 99952 

14 

3 

0 9 

0 81594 

2540 

241 

3 4 

0 99966 

11 

4 

1 0 

0 84134 

2299 

239 

35 

0 99977 

7 

<— 

1 1 

0 85433 

2060 

233 

3 6 

0 99984 

5 

— 

i 2 

0 88493 

1827 

223 

37 

0 99989 

4 


1 3 

0 90320 

1604 

209 

3 8 

, 0 99993 

2 

— 

1 4 

0 91924 

1395 1 

1 194 

i 

3 9 

1 0 99995 

2 

1 

— 

1 5 

0 93319 

1201 

1 

178 

40 

0 99997 

1 

i 1 

_ 

1 6 

0 94520 

1023 I 

, 159 

4 1 

0 99998 

1 1 

— 

1 7 

0 95543 

864 

1 143 

42 

0 99999 

— 

— 

I 8 

0 91)407 

721 f 

' 124 

43 

1 0 99999 

1 — 


1 9 

0 97128 

597 

108 

44 i 

1 0 99999 ; 

I 

j •—« 

2 0 

0 97726 

489 

93 

1 




2 1 

0 98214 

396 

78 





22 

0 98610 

318 

66 


1 

I 


2 3 

0 98928 

262 

63 





24 

“ — -r 

0 99180 

199 1 

1 

44 






F attainB the exact value 0 99999 between 4 26 and 4 27. 


Primes on of Interpolation .—Simple interpolation may lead to an error of 3 or 4 at most m the fourth 
plac^ of decimals in the region where second differences are large , the use of tlie second difference wiU 
bring this down to 2 or 3 m the last place, the largest errors tending to occur at the begmning of the 
table, where the third difference may be used if the greatest possible precision is dosir^. 
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APPENDIX 


t-Tahhi 


Tike Distribution Function 



(Condensed to three figures from 


for Valtm of t 
the four-figure 


t. 

P ^ 1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7 . 

8 . 

9 . 

10 . 

0 

0*500 

0*500 

0*600 

0*500 

0*600 

0*500 

0-500 

0*500 

0-600 

0*500 

01 

0-632 

0-636 

0*537 

0*537 

0*538 

0*538 

0-538 

0*639 

0-689 

0*539 

0-2 

0*563 

0570 

0*573 

0-574 

0*676 

0*676 

0-676 

0-677 

0-677 

0-677 

0-3 

0*593 

0*604 

0-608 

0*610 

0-612 

0*613 

0-614 

0-614 

0-6145 

0-616 

0‘4 

0-621 

0*636 

0*642 

0*645 

0*647 

0*6485 

0-6495 

0*660 

0*661 

0*661 

0-5 

0*648 

0*667 

0*674 

0*678 

0-681 

0*683 

0-684 

0-686 

0 - 686 ' 

0-686 

0-0 

0*672 

0*696 

0*705 

0*710 

0713 

0*716 

0-716 

0-717 

0-718 

0-719 

0-7 

0-694 

0-722 

0*733 

0*739 

0-742 

0-746 

0-747 

0-748 

0-749 

0-760 

0*8 

0-716 

0*746 

0*769 

0*766 

0-770 

0*773 

0*775 

0-777 

0-772 

0-779 

0*9 

0*733 

0*768 

0*783 

0 - 700 ® 

0*796 

0*799 

0*801 

0-803 

0-804 

0-805 

10 

0*760 

0*789 

0*8045 

0-813 

0*818 

0-822 

0-826 

0-827 

0-828 

0-830 

M 

0*766 

0*807 

0*824 

0*8335 

0*839 

0*843 

0-846 

0-848 

0-850 

0-851 

1*2 

0*779 

0 * 823 « 

0-842 

0*862 

0*868 

0*862 

0-865 

0-868 

0-870 

0-871 

1-3 

0*791 

0*838 

0*858 

0*868 

0-876 

0-879 

0-883 

(^885 

0-887 

0-889 

1-4 

0*803 

0*862 

0-872 

0*883 

0*890 

0 - 894 ' 

0*898 

O - flOO -' 

0-9025 

0-904 

1-6 

0*813 

0*864 

0-886 

0*896 

0-903 

0-908 

0*911 

0-914 

0-916 

0-918 

1*6 

0*822 

0-876 

0-896 

0-908 

0*915 

0 920 

0-923 

0-920 

0-928 

0-930 

1*7 

0*831 

0*884 

0-906 

0*918 

0-926 

0*930 

0-933 ■' 

0-936 

0-938 

0*940 

1*8 

0-839 

0*893 

0*916 

0*927 

0*934 

0*939 

0*943 

0 946 

0*947 

0-949 

1*9 

0*846 

0*901 

0-923 

0*935 

0*942 

0*947 

0-960 

0-953 

0*955 

0-967 

2*0 

0*862 

0*908 

0-930 

0*942 

0*949 

0-964 

0-957 

0 - 9 C 0 

0*962 

0-963 

21 

0 * 858 » 

0*915 

0*937 

0*948 

0-965 

0-960 

0*963 

0*0655 

0*967 

0*969 

2*2 

0*864 

0*921 

0*942 

0*954 

0 * 96()5 

0-965 

0*968 

0*0705 

0*972 

0-974 

2*3 

0 - 869 ‘ 

0*926 

0*9475 

0*9585 

0-965 

0-960 

0 - 972 ' 

0*075 

0 - 976 ' 

0-978 

24 

0*874 

0-931 

0*962 

0*963 

0*969 

0-973 

0*976 

0*978 

0*980 

0 981 

24 

0*879 

0-936 

0*956 

0*967 

0 973 

0*977 

0 - 979 ' 

0 9815 

0-983 

0-984 

24 

0*883 

0-939 

0*960 

0*970 

0*976 

0-980 

0*982 

0-984 

0-986 

0-987 

2-7 

0-837 

0*943 

0*963 

0*973 

0*979 

0*982 

0*985 

0 - 986 ' 

0-988 

0 989 

2*8 

0-891 

0-946 

0*966 

0*976 

0*981 

0*984 

0*987 

0 - 98 H 

0*990 

0 991 ' 

2*9 

0*894 

0-949 

i 0*969 

0*978 : 

0-983 

()* 98 f ) 

1 0*9885 

0*990 

0*991 

0-992 1 

3*0 1 

0*898 

0-952 i 

0*971 

0*980 

0 985 

0*988 

1 0-990 

0*0915 

i 0 9925 

' 0 993 

3*1 

0*901 

1 0*956 

0*973 

0*982 

0-987 

0-989 

1 0*991 

0*093 

' 0 991 

0 994 1 

3*2 j 

0*904 

1 0-967 

0*975 

0*9835 

0-988 

0*991 

1 0 9925 

0-994 

1 0 995 

«)*995 

34 1 

0*906 

! 0*960 

0 977 

0*985 

0*989 

0*992 

0 993 

0-995 

{> !> 9 :> 

0 996 

34 1 

0*909 

i 0 ' 9()2 

0*979 

i 0*986 

’ 0*990 

* 0-993 

! 0 994 

0-995 

1 0 99 o 

0 997 

3 5 ' 

0*911 ! 

1 0*964 

1 0*980 

0*988 

0-991 

I 0-994 

1 0 905 

, 0-996 

1 0-997 

0-997 

3 () 

0*914 1 

0-965 

1 0-982 

0*989 

0 992 

1 0-994 

0*996 

' 0-9965 

0 997 

0 998 

3*7 ' 

0*916 : 

0*967 

i 0-983 

0*990 

0-093 

' 0 995 

' 0 996 

' 0-997 

, 0 9975 

0 998 

3*8 

0*918 

0-969 

1 0-984 

0*990 

0-904 

' 0*9955 

0-997 

0-997 

0*998 

0 998 

3*9 

0*920 

0*970 

1 0-985 

0*991 

0-994 

1 0*996 

0*997 

0-998 

0*998 

0 - 998 ® 

4-0 

0*922 

0*971 

0-986 

0*992 

0*995 

0*996 

0*997 

1 0-998 

1 0*998 

0 999 

4*1 

0*924 

0*973 

0*987 

0*993 

0*995 

0*997 

0*998 

0 - 99 S 

1 0*999 

0-999 

4*2 

0*926 

0*974 

0*988 

0*993 

0-996 

0*997 

0*998 

1 0-9985 

0*999 

0 999 

4*3 

0*927 

0*975 

0*988 

0*994 

0-996 

0*9975 

0*908 

0 990 

, 0 999 

0-999 

44 

0*929 

0*976 

0*989 

0*994 

0-9965 

0*998 

0*998 

1 0-999 

0*999 

0-999 

4*5 

0*930 

0*977 

0*990 

0*995 

0-997 

0-998 

0*999 

0-999 

0*999 

{ 0-999 

4*0 

0*932 

0-978 

0-990 

0*995 

0-997 

0*998 

0*999 

0-999 

1 0-999 

1 0 * 999 ® 

4-7 

0*933 

0*979 

0-991 

0*905 

0*997 

0*998 

0*099 

0-099 

1 0-909 

^ 10(^0 

4-8 

0*935 

0*980 

0*991 

0*990 

0*998 

0*9985 

0*999 

1 0-099 

1 0*9905 


4*9 

0*936 

0*980 

0*992 

0-996 

0*998 

0*999 

0*999 

1 0-099 

1 1-000 


5*0 

0*937 

0*981 

0*992 

0*996 

0-998 

0-999 

0-999 

I 0-0905 


1 

5*1 

0*938 

0*982 

0-993 

0-9965 

0*998 

0-999 

0-999 

0-9995 


1 

1 

6*2 

0 * 939 ^ 

0*9825 

0-993 

0-997 

0*998 

0 999 

0-999 

1-000 


1 

5*3 

0*941 

0*983 

0-993 

0*997 

0*998 

0-999 

0*999 




6*4 

0*942 

0*984 

0*994 

0*997 

0*9985 

0*999 

(>•9995 




55 

0*943 

0*984 

0-994 

0*997 

0-999 

0-999 

0-9995 




56 

0*944 

0*986 

0*994 

0-9975 

0-999 

0-999 

1-000 




5*7 

0*945 

0*986 

0*995 

0*998 

0-999 

0-999 





6*8 

0*946 

0*986 

0*995 

0*998 

0-999 

0-999 


1 



59 

0*947 

0*986 

0*995 

0*998 

0*909 

0-9995 


1 



60 

0*947 

0*987 

0*995 

0*998 

0-999 

0-9905 

1 
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TABLE 3 


proceeding hy Intervals of 0-1 from 0 to 6, and for Values of v from 1 to 20. 


tables by “ Student ” in Metrmi, 5, 1925.) 


L 

11 . 

12 . 

13. 

14. 

16. 

16. 

17. 

18. 

19. 

20 . 

0 

0*500 

0*500 

0*500 

0*500 

0*600 

0-500 

0*500 

0-500 

0*500 

0*500 

0*1 

0*639 

0*539 

0*530 

0*539 

0-539 

0*639 

0*639 

0-539 

0*530 

0*539 

0*2 

0*677 

0*578 

0*678 

0*678 

0*678 

0*678 

0-578 

0-578 

0*578 

0*578 

0*3 

0*616 

0*015 

0-C15« 

0*610 

0*616 

0*616 

0*616 

0*616 

0-616 

0*616 

0*4 

0*662 

0*662 

0-662 

0*652 

0*653 

0*663 

0*663 

0*663 

0*653 

0*653 

0*6 

0 *686*^ 

0*687 

0*687 

0*088 

0*688 

0*688 

0*688 

0*688 

0*689 

0*689 

0*6 

0*720 

0*720 

0*721 

0*721 

0*721 

0-721* 

0*722 

0*722 

0*722 

0*722 

0*7 

0*761 

0*761 

0-762 

0-762 

0*763 

0*763 

0*753 

0*754 

0*764 

0*754 

0-8 

0*780 

0*780 

0*781 

0-781‘ 

0-782 

0*782 

0*783 

0*783 

0*783 

0*783 

0*9 

0*806 

0*807 

0*808 

0*808 

0*809 

0*809 

0*810 

0*810 

0-810 

0-811 

1*0 

0*831 

0*831» 

0*832 

0*833 

0*833 

0*834 

0*834 

0*835 

0*835 

0-836 

1*1 

0*863 

()*853« 

0*854 

0*865 

0*866 

0*856 

0*857 

0-8.57 

0*857® 

(i*858 

1*2 

0*872 

0-873 

0-874 

0*875 

0-876 

0*876 

0*877 

0*877 

0*878 

0*878 

1*3 

0*890 

0-891 

0*892 

0-893 

0 893 

0*894 

0*894® 

0*895 

0*895 

0*896 

1*4 

()*906® 

0*907 

0*907® 

0-908 

0*909 

0*910 

0*910 

0*011 

0-911 

0*912 

1*6 

0*919 

0*920 

0*921 

0*922 

0*923 

0*923® 

0*924 

0*924® 

0-925 

0*926 

1*0 

0*931 

0*932 

0*933 

0*934 

0*935 

0*935 

0-936 

0-936'^ 

0*937 

0*937 

1*7 

0*941 

0*943 

0*943® 

0*944 

0*945 

0*946 

0*946 

0*947 

0-947 

0*948 

1*8 

0*950 

0*95 

0-952® 

0*953 

0-054 

0*956 

0*955 

0*956 

0*956 

0-966* 

1'9 

0*958 

0*969 

0*960 

0*961 

0-962 

0*962 

0*963 

0-963 

0*964 

0*964 

2*0 

0 905 

0*966 

0*967 

0*967 

0*968 

0*960 

0-969 

0-970 

0-970 

0*970 

2*1 

0*970 

0*971 

0 972 

0-973 

0*973® 

0*974 

0-974® 

0*975 

0-975 

0-976 

2*2 1 

0*975 

. 0*976 

0*977 

0*977 

; 0*978 

1 0*979 

1 0-979 

1 0*979 

0*980 

0*980 

2*3 1 

0*979 

! 0*980 

1 0*981 

0-981 ' 

' 0 982 

0*982 

1 0-983 

1 0*983 

0*983® 

0*984 

2*4 1 

0*982 

1 0*98:i 

0 984 

0-985 

0*985 

, 0*985® 

' 0-980 

1 0-986 

0*987 

0*987 

2*6 1 

1 0*986 

1 0*986 

0*987 

0-987 

' 0*988 

0*988 

' 0*988® 

i 0-989 

0*989 

1 0*989 

2*0 ! 

1 0*988 

1 0*988 

0-989 

0-989® 

1 0*990 

, 0-990 

1 0-991 

i 0*991 

j 0*991 

! 0*991 

2*7 

0*990 

> 0*990 

0 991 

0-991 

' 0*992 

] 0*992 

0*992 

, 0*993 

! 0*993 

, 0*993 

2*8 * 

0*991 

1 0*992 

0-992® 

0-993 

' 0*993 

1 0*994 

0*994 

1 0*994 

; 0*994 

1 0 994® 

2*9 ! 

0*993 

0*993 

0-994 

0-994 

1 0*994® 

0*994® 

i 0-996 

0*995 

0-995 

! 0-996 

30 1 

0*994 

! O 094» 

0-995 

0-995 

0*996® 

0*996 

, 0-996 

1 0-996 

0-996 

1 0-990® 1 

3*1 1 

0*996 

0*995 , 

1 0 996 

0-996 

' 0*996 

0*997 

0-997 

1 0-997 

0-997 

! 0*997 

3*2 ' 

0-996 

0 996 1 

1 0-996® 

0-997 

0-997 

0 997 

1 U-997 

0-997® 

0-998 

0*998 

3*3 1 

; 0*996^ 1 

0*997 1 

0*997 

0-997 

0-998 

1 0*998 

, 0-998 

1 0-998 

0*998 

1 0-998 

3*4 1 

0*997 

0*997 

0*998 

0-998 

0-998 

' 0-998 

I 0-998 

1 0*998 

0*998® 

0-999 

3*6 

0 997^ 

1 0-998 

0 998 

0-998 

0-998 

0-998® 

> 0-999 

1 0*999 

0*999 

0-999 

3*6 

0-908 

0*998 

0*998 ! 

0*999 

0-999 

! 0-999 

' 0-999 

1 0-999 

0*999 

1 0-999 

3*7 

0*998 

0*998® 

0*999 i 

0*999 j 

I 0-999 

1 0-999 

0-999 

' 0-999 

0*999 

0*999 

3*8 

0*998^' 

0*999 

0*999 1 

0-999 1 

i 0*999 

, 0-999 ^ 

, 0-999 1 

1 0-999 

0*999 

0*999 

3*9 

0*099 

0*999 

0*999 1 

[ 0*999 

0-999 

[ 0*999 ' 

0-999 

[ 0*999® 

0*990® 

1*000 

4*0 

0*999 

0*999 

0*999 

I 0*999 

0-999 

0*999® 

0*999*® i 

1*000 

1*000 


4*1 

0*999 

0*999 ] 

()-990 

0*999® 

0-999® 

1*000 1 

1*000 1 




4*2 

1 0*999 

0 999 I 

0*999® 

1*000 

1*000 

1 

1 



1 

4*3 

0*999 

0*999® 

1*000 ! 



i 

1 



1 

4*4 


1*000 1 





1 



1 

4*5 

0*909ft 

1 




1 

1 

1 



1 

4*6 

1 000 



1 





1 

1 


_ _ _ 

_ _ 



- 


- 

— 

-- 

_ 


j^ote ,—The methods by which “ Student ” calculated the Matron tables arc explained in notes by him 
and K. A. Fisher in that journal, vol. 5, Part 3, 1925, pp. 18-24. The four figures of those values have been 
rounded up to three in the above table, except when the four-figure value concluded with a 5, in which case 
it is shown in full. In columns in which values greater than 0*9996 occur the first is written TOGO and the 
remainder left blank. 


441 











Values of 


442 


APPENDIX TABLES 


APPENDIX TABLE 4 

(Beprinted from Table VI of Prof. R. A. Fisher’s Statistical Methods for Research Workers, 
Oliver and Boyd, Ltd., Edinburgh, by kind permission of the author and the publishers.) 

6 Pee Cent. Points op the Dxsthibxjtion of z. 


Values of Pj. 



1. 

2« 

3. 

4. 

6. 

6. 

8. 

12. 

24. 

OD. 

1 

2*5421 

2*6479 

2*0870 

2*7071 

2-7194 

2*7276 

2*7380 

2*7484 

2-7588 

2*7693 

1 2 

1 4592 

1*4722 

1*4765 

1*4787 

1*4800 

1*4808 

1*4819 

1*4830 

1-4840 

1*4851 

3 

M677 

1*1284 

M137 

1*1051 

1*0994 

1*0963 

1*0899 

1 0842 

1 0781 

1*0716 

: 4 

10212 

0*9690 

0*9429 

0*9272 

0*9168 

0 9093 

0 8993 

0*8885 

0*8767 

0*8639 

5 

09441 

0*8777 

0*8441 

0*8236 

0*8097 

0*7997 

0*7862 

0*7714 

0 7560 

0*7368 

6 

0*8948 

0*8188 

0*7798 

0*7568 

0 7394 

0*7274 

0*7112 

0*6931 

0*6729 

0*6499 

7 

0*8606 

0*7777 

0*7347 

0*7080 

0*6896 

0*6761 

0*6576 

0*6309 

0 6134 

0*5862 


0*8355 

0*7475 

0*7014 

0*6726 

06525 

0*6378 

0 6175 

0 6945 

0*5682 

0*5371 

9 

0*8163 

0*7242 

0*6757 

0*6460 

0*6238 

0*6080 

0*6862 

0*5613 

0 5324 

0*4979 

1 10 

t 

0 8012 

0*7058 

0*6553 

0*6232 

0 6009 

0*5843 

0*6611 

0 5346 

0 6035 

0-4657 

11 

0*7889 

0*6909 

0*6387 

0-6065 

0*5822 

0*5648 

0*5406 

0*5126 

0 4795 

0*4387 

i 12 

0*7788 

0*6786 

0*0260 

0-6907 

0 5666 

0*5487 

0*5234 

0*4941 

0 4592 

0*4166 

1 13 

0*7703 

0 6682 

0*6134 

0-6783 

0*5536 

0*5350 

0 5089 

0*4785 

0*4419 

0*3957 

; 1^ 

0*7630 

0*6594 

0*6036 

0-5677 

0 6423 

0 5233 

0*4964 

0*4649 

0*4269 

0 3782 

! 15 

0*7568 

0*6518 

0*695() 

0-5686 

0-6326 

0*5131 

0*4865 

0*4532 

0*4138 

0*3028 

; 16 

0*7514 

0*6451 

0*5876 

0-5606 

0*5241 

0 6042 

0*4760 

0*4428 

0*4022 

0*3490 

1 17 

0*7466 

0*6393 

1 0 5811 

0 6434 

1 0 5166 

, 0*4964 

' 0*4676 

' 0 4337 

0*3919 

0 3366 1 

' 18 

0*7424 

0*6341 

0*5753 

0 6371 

0 5099 

1 0*4894 

0*4602 

0*4255 

' 0*3827 

03263 

! 19 

0*7386 

0*6295 

f 0*5701 

0 6315 

1 0*5040 

1 0*4832 

0 4535 , 

04182 

1 0*3743 j 

0*3151 1 

i 20 

0*7352 

0*6254 

1 O'0654 

0-626.5 

' 0*4986 

' 0-4776 

0*4474 1 

j 

0*4116 ! 

1 0*3668 

0 3057 

( 

21 

0 7322 

0*6216 

( 0*6612 

i 0-5219 

0*4938 

0-4725 

0*4420 ’ 

' 0-4055 

! 0*3599 

0-2971 

1 22 ' 

1 0*7294 

0*6182 

' 0-5574 

0-6178 1 

^ 0-4894 ’ 

‘ 0*4679 ! 

0 4370 

! 0*4001 

1 0*3636 

0-2892 

’ 23 

0*7269 

0*6151 

I 0*5540 

1 0 5140 j 

0 4854 , 

0*4636 

0*4325 

0*3950 i 

1 0 3478 

0-2818 

1 24 

0*7246 

0*6123 

' 0*5508 

j 0-6106 

0 4817 ! 

0 4598 , 

0*4283 

0 3904 i 

0*3425 

0-2749 

25 

0*7225 

0*6097 

! 0*5478 

1 0-6074 1 

; 0*4783 

0*4562 

0*4244 

0*3862 

0*3376 

0-2685 

, 20 

0*7205 

0*6073 

0*5451 

1 0-5045 

0 4752 1 

, 0*4629 

0*4209 

0*3823 

0 3330 

0-2626 

. 27 

0*7187 

0*6051 

0*5427 

0-6017 

0*4723 1 

1 0*4499 

04176 

0*3780 

0*3287 

0-2669 

1 28 

0 7171 

0*6030 

' 0*5403 

0 4992 

1 0 4696 ! 

1 0*4471 

0*4146 1 

0*3752 1 

0 3248 

0-2616 

29 

0*7155 

0*6011 

1 0*5382 

0-4969 

0*4671 

1 0*4444 

0*4117 

I 0*3720 

0*3211 

0-2466 

* 30 

( 

0*7141 

j 

0*5994 

1 0*5362 

0-4947 

0*4648 

' 0*4420 

0*4090 1 

0*3691 

0*3176 

0-2419 

1 

' 60 

1 0 0933 

1 

0*5738 

’ 0 5073 

1 j 

0 4632 

1 

• 0*4311 

! 1 

1 0*4064 . 

0*3702 

1 

0-3255 

0*2654 

01644 

t ' 

I 00 ; 

0*6729 ; 

0*5486 

1 0 4787 

0*4319 

0-3974 

1 0*3706 , 

0*3309 * 

0-2804 

0*2086 

I 0 


I 
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APPENDIX PABLE 6 


(Bejmnt^d from Table VI of Prof. R, A. Fisher’s Statistical Methods for Mesearch Workers, 
Oliver and Boyd, Edinburgh, by kind permission of the author and the publishers.) 

1 Per Cent. Points or the Distkibution or z. 


Values of 


1 

1. 

4 1535 

2, 

4-2686 

3. 

4-2974 

4. 

4 3175 

5. 

4*3297 

6. 

4-3379 

8. 

4-3482 

12. 24. 

. I —, 

4-3585 1 4*3689 

00. 

4-3794 

1 2 

2-2950 

2*2976 

2-2984 

2-2988 

2 2991 

2-2992 

2-2994 

2-2997 

2-2999 

2-3001 

3 

1-7649 

1*7140 

1*6915 

1*6786 

1*6703 

1*6646 

1-6569 

1-6489 

1-6404 

1*8314 

4 

1 5270 

1 -4452 

1*4075 

1*3856 

1*3711 

1*3009 

1 3473 

1*3327 

1 3170 

1 3(X)0 

1 5 

1 3943 

1*2929 

1 2449 

1-2164 

1-1974 

1*1838 

1*1656 

1 1457 

1-1239 

1-0997 

6 

1-3103 

1-1955 

1*1401 

1*1068 

1 0843 

1*0680 

1*0460 

1*0218 

0-9948 

0-9643 

7 

1*2526 

M281 

1-0672 

1*0300 

1-0048 

0-9864 

0*9614 

0-9335 

0-9020 

0-8668 

8 

1 2106 

1-0787 

1-0135 

0*9734 

0-9459 

0*9259 

0*8983 

0-8673 

0-8319 

0-7904 

9 

M786 

1-0411 

0-9724 

0-9299 

0*9006 

0-8791 

0*8494 

0-8157 

0-7769 

0-7305 

' 1 10 

M535 

1-0114 

0-9399 

0-8954 

0-8646 

0-8419 

0*8104 

0-7744 

0-7324 

0-6816 

11 

11333 

0-9874 

0-9136 

0 8674 

0-8364 

0-8116 

0*7785 

0-7406 

0-6968 

0 6408 

12 

M166 

0 0677 

0-8919 

0 8443 

0*8111 

0*7864 

0-7520 

0*7122 

0-6649 

0-6061 

13 

11027 

0-9511 

0-8737 

0-8248 

0*7907 

0-7662 

0-7295 

0-6882 

0-6386 

0-6761 

> 14 

1 -0909 

0-9370 

0 8581 

0-8082 

0*7732 

0-7471 

0-7103 

0-6675 

0-6159 

0-6.500 

. 15 

1*0807 

0-9249 

0-8448 

0-7939 

0*7582 

0*7314 

0*6937 

0-6496 

0-5961 

0 5269 

® 16 

10719 

0 9144 

0 8331 

0-7814 

0*7450 

0-7177 

0*6791 

0-6339 

0-6786 

0 5064 

I 1 

1 10641 

0 9051 

0-8229 

0*7705 

0*7335 

0-7057 

1 0*6663 

0-6199 

0-6630 

0-4879 

1 1 18 1 

1 0672 

0-8970 

0-8138 

0-7607 

0 7232 

0-6950 1 

i 0-6549 

0-6076 

0-6491 

0-4712 

;> 19 i 

I 10611 ! 

0-8897 

0-8057 

0-7521 

0*7140 

0*6854 1 

0-6447 

0-5964 

0-6366 

0 4560 

, 20 

1 0467 

j 

0-8831 

0-7985 

0-7443 

0*7058 

0-6768 1 

0*6355 

0-6804 

0-6253 

0*4421 

21 

1*0408 

0-8772 

0-7920 

0-7372 

0*6984 

* 0-6690 

0-6272 

0-5773 

0-6150 

0-4294 

, 22 

1-0363 

0-8719 

0-7860 

0 7309 

0*6916 

I 0-6620 

0-6196 

0*5691 

0-60.56 

0 4176 

23 

1-0322 

0 8670 

0-7806 

0-7251 

0 6855 

0-6555 

0-6127 

0*5615 

0-4969 

0*4068 

24 

1*0285 

0-8626 , 

0 7757 

0-7197 

0*6799 

0-6496 

0*6064 

0-5545 

0-4890 

0-3967 

25 

1-0251 

I 0-8585 , 

0-7712 

0-7148 

0*6747 

0-6442 

0-6006 

0-5481 

0-4816 

0-3872 

; 26 

1*0220 

! 0-8548 

0-7670 

0 7103 

0 6699 

0-6392 

0*5952 

0-5422 

0-4748 

0*3784 

1 27 

1*0191 

0-8513 

0 7631 

0-7062 

1 0*6655 

0*6346 

0-5902 

0-5367 , 

0-4685 

0-3701 

> 28 

1-0164 

i 0-8481 

0-7595 

0*7023 

0-6614 

0-6303 

0-5856 

0*5316 1 

0-4626 

0 3624 

1 29 

1*0139 

i 0-8451 

0-7562 

0-6987 

0*6576 

1 0*6263 

0 5813 

0-5269 1 

0-4670 

0-3550 

1 30 

1*0116 

0 8423 

0*7531 

0*6954 

0*6540 

0*6226 

0-5773 1 

0 5224 1 

0-4619 

0-3481 

, 60 

0-9784 

0*8025 

0*7086 

0-6472 

1 0*6028 

! 

1 

: 0*5687 | 

0*5189 1 

0-4574 

1 

0-3746 

0 2352 

j 00 

1 

0*9462 

0*7636 

0-6651 

0*5999 

0*5522 

0-5152 

0*4604 1 

0-3908 j 

0-2913 

0 






444 


APPENDIX TABLES 


APPENDIX TABLE 6 


Distribution Function of for One Degree of Freedom for Valu^ of from x^ = 0 to 

X^ — 1 by steps of O-Ol. 



F 

A 


P 

J 

0 

1*00000 

7966 

0*50 

0*47960 

436 

001 

0*92034 

3280 

0*61 

0*47514 

430 

002 

0*88754 

2506 

0-52 

0*47084 

423 

003 

0*86249 

2101 

0 53 

0*46661 

418 

004 

0-84148 

1842 

0 64 

0*40243 

411 

005 

0*82306 

1666 

0*55 

0-46832 

406 

0*06 

0*80650 

1516 

0*66 

0*45426 

400 

007 

0*79134 

1404 

0*67 

0 45026 

395 

008 

0*77730 

1312 

0-58 

0-44631 

389 

009 

0*76418 

1235 

0*59 

0*44242 

384 

010 

0*75183 

1169 

0*60 

0-43858 

379 

0 11 

0*74014 

1111 

0 (il 

0*43479 

371 

012 

0 72903 

1060 

0 62 

0*43106 

369 

013 

0*71843 

1015 

0-63 

0-42736 

305 

014 

0*70828 

974 

0-64 

0-42371 

360 

015 

0*69854 

938 

0-65 

0 42011 

355 

016 

0*68916 

905 

0*66 

0 41666 

351 

0 17 

0-68011 

874 

0*67 

0-41306 

34(i 

0*18 

0-67137 

845 

0*68 

0-40959 

343 

019 

0*66292 

820 

0-69 

0-40616 

338 

0-20 

0*65472 

795 

0*70 

0-40278 

334 ! 

0-21 

0 64677 

773 

0*71 

0-39944 

330 1 

0-22 

0 63904 

762 

0-72 

0*39614 

32(1 

0-23 

0 63152 

731 

0*73 

0-39288 

322 

0-24 

0 62421 

713 

0*74 

0-38966 

) 318 

0-25 

0*61708 

i 696 

0 75 

0-38648 

1 315 

0 26 

0*61012 

! 679 

0*76 i 

0-38333 

311 

0 27 

0 60333 

663 

0 77 

0-38022 

308 

0-28 

0*59670 

648 

0 78 

0-37714 1 

304 

0*29 

0*59022 

634 

0*79 ' 

0-37410 

301 

0-30 

0*58388 

620 

0 80 ‘ 

0-37109 

297 

031 j 

0*57768 

607 

0 81 ' 

0-36812 

291 

0'32 

0*57161 1 

595 

0*82 1 

0-36518 

201 

0-33 I 

0*56566 

583 

0*83 1 

0-36227 

287 

0-34 1 

0*55983 

572 

0*84 

0-36940 

285 

0-36 

0*55411 

560 

0*85 I 

0-36056 

281 

0-36 

0*54851 

561 

0*86 

0-36374 

278 

0'37 

0*54300 

540 

0*87 

0-36096 

276 

0-38 

0*53760 

530 

0*88 

0-34820 

272 

0*39 

0*53230 

521 

0*89 ' 

0-34548 

270 

0*40 

0*52709 

512 

0*90 1 

0-34278 

267 

0-41 

0*52197 

503 

! 0*91 1 

0-34011 

264 

0*42 

0*51694 

495 

0 92 i 

0 33747 

261 

0*43 

0*51199 

487 

0*93 1 

0-33486 

258 

0*44 

0*60712 

479 

0*94 

0-33228 

266 

0*46 

0*50233 

471 

0 95 

0-32972 

253 

0*46 

0*49762 

463 

0*96 

0-32719 

251 

0*47 

0*49299 

467 

0*97 

0-32468 

248 

0*48 

0*48842 

449 

0*98 

0-32220 

246 

0*49 

0*48393 

443 

0*99 

0 31974 

243 

0*60 

0*47950 

436 

1*00 

0 31731 

241 
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APPENDIX TABLE 7 

Distribiiiion Function of for One Degree of Freedom for Valuer of from 1 io 10 by 
. Steps of 01. 



P 

A 


P 

A 


10 

0*31731 

2304 

6*5 

0*01902 

106 


M 

0*29427 

2095 

5*6 

0*01796 

99 


1-2 

0*27332 

1911 

6*7 

0*01697 

94 


13 

0*25421 

1749 

5*8 

0*01603 

89 


14 

0 23072 

1605 

5*9 

0 01514 

83 


1-5 

0*22067 

1477 

6*0 

6-01431 

79 


1*6 

0 20590 

1361 

6*1 

0-01362 

74 


1-7 

0*19229 

1258 

6*2 

0*01278 

71 


1-8 

0*17971 

1163 

6*3 

0*01207 

66 


1*9 

0*16808 

1078 

6*4 

0 01141 

62 


2 0 

0 16730 

1000 

6*5 

0*01079 

59 


2 1 

0 14730 

929 

6*6 

0-01020 

56 


2 2 

0*13801 

864 

6*7 

0*00964 

52 


2 3 

0-12937 

803 

6*8 

0*00912 

50 


2 4 

012134 

749 

6*9 

0*00862 

47 


2*5 

0*11385 

699 

7*0 

0*00816 

44 


2 0 

0 10080 

651 

7 1 

0*00771 

42 


2 7 

0 10035 

609 

7*2 

0*00729 

39 


2-8 

0 09426 

568 

7*3 

0-00690 

38 


29 

0*08858 

532 

7*4 

0*00652 

35 


30 

0 08320 

497 

7*5 

0-00617 

33 


3 1 I 

0 07829 

465 

7*6 

0*00584 

32 


3 2 1 

0 07364 1 

436 

7*7 

i 0*00562 

30 


3 3 

0 06928 1 

408 

7*8 

0 00522 

28 


3 4 

0*06520 

383 

7*9 

0*00494 

20 


3 5 

006137 

359 

8 0 

0*00468 

25 


3f> 

0*05778 

337 

8*1 

0*00443 

24 


3 7 

0*06441 

316 

8*2 

0*00419 

23 

1 

3-8 

0*05125 

296 

8*3 

0*00396 

21 

1 

3-9 I 

0*04829 

279 

8 4 

0*00375 

20 


4‘0 1 

0*04550 ' 

262 

8*5 

0*00355 

19 


4-1 I 

0*04288 

246 

8*6 

0 00336 

18 


4*2 

0 0*4042 

231 

8*7 

0*00318 

17 


4*3 

0*03811 

217 

8*8 

0*00301 

16 

1 

4 4 

0*03594 

205 

8*9 

0*00285 

15 

1 

4 5 

0*03389 

192 

9*0 

0-00270 

1 

! 

4-6 

0 03197 

181 

9 1 

0*00256 


! 

4-7 

0*03016 

170 

9*2 

0*00242 

1 13 


4-8 

0*02846 

160 

9*3 

0*00229 

12 


4*9 

0 02686 

151 

9*4 

0*00217 

12 


50 

0*02535 

142 

9*5 

0*00205 

10 


51 

0 02393 

134 

9*6 

0*00195 

11 


5'2 

0*02259 

126 

1 9*7 

0*00184 

10 


5*3 

0*02133 

119 

9*8 

0 00174 

9 


5 4 

0*02014 

112 

9 9 

0*00165 

8 


5-5 

0*01902 

106 

10*0 

0*00157 

8 
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Abortion, distribution of women according to teim 
of, {Table 1,23), 26. 

Abrupt distributions, corroctions for grouping to, 
79; refs., 85-6. 

Absolut© moments, 66 ; LiapoimofF’s inequality 
for, (Exercise S.14), $8. 

Aockienta, exemplified by Poisson distribution, 
124. 

Adyanthaya, N. K., refs., distribution of frequency 
. constants in small samples, (under Pearson), 
228. 

Age, correlation with highest audible pitch, 
(Table 14.1), 325 ; (Example 14.1), 331. 

Agreement, coefficient of, 427-9 ; sigiiilicanee of, 
429-36. 

Agi'icultural Research Institute, Oxford, data 
from Report of, (Table 1.9), 9. 

Alcoholism and crime, Goring’s data on, (Table 
14.6), 366. 

- and h(‘alth, (Exercise 14.12), 366. 

Ammon, O., data from (hair and eye-colour), 
(Table 12.4), 300. 

Antliropometric Gonimittoo of British Association, 
data from Report of, (Table 1.7), 8; 
(Table 1.10), 10. 

Antimodo, definition of, 35. 

Approximations to sampling distributions, see 
Sampling distributions. 

Arithmetic moan, see M(‘an, arithmetic. 

Aroian, L. A., fitting of TyP^' ^ distribution to 
data, (Exainplt? 0.4), 150 ; refs., Type B 
serums, 100. 

Arrays, in bivariate distributions, 327. 

Association, gem^rally, 308 23; coefficients of, 
310-13; partial, 313-17 ; illusory, 317-18. 

Asymmetrical distributions, 10 ; see Bkewnoss. 

AttribuUiB, sampling of, 197-201 ; in Poisson dis¬ 
tribution, (Exercise 8.2), 203 ; in finite 
populations, (Exercise 8.3), 203. 

Australian marriages, distribution of, (Table 1.8), 
9; moments of, (Example 3.1), 6(1-2; 
and of, (Example 3.10), 82. 

AveragtJ, see Mean. 

—— cormetions (o moments, 74-6; set* also 
Sheppard’s corrections. 

6, (sampling value of measure of skewness), 
279-^80. 

Babington 8mitb, B., data from, on random num¬ 
bers, (Table 8.3)* 189 ; Random Sampling 
Numbers, 193, 197 ; ivfs. (under Kendall), 


202 ; distribution of Spearman’s p, problem 
of m rankings, method of paired com¬ 
parisons, 436. 

Baker, G. A., distribution of means in Type A 
series, (Exercise 10.7), 262. 

Bayes, T., refs., doctrine of chances, 183* 

Bayes’ theorem, 175-7 ; postulate, 176-8 ; com¬ 
parison with maximum likelihood, 178-80 ; 
in estimating proportion of attributes, 200 ; 
(Exercise 8.6),' 203. 

Beans, distribution of, (Table 1.16), 20 ; histogram 
of, (Figure 1.4), 20 ; fitting of Pearson dis¬ 
tribution to, (Example 6.1), 143-4 ; (Jlrarn- 
C/harlier series fitted to, (Example 6.2), 161, 
Bemouilli polynomials, definition of, 58. 

- numbers, footnote, 69; 71, 78. 

Bernstein, S., refs., extension of central limit 
theorem, 183. 

/?!, ^2 (skewness and kurtosis), 81 ; standard errors 
of, 225 ; sampling distribuiionB of, 279-80, 
(Exercise 11.17), 289; generalised p. 82. 
jB- function, in summing binomial, 120, 

Bias in sampling, 187-90 ; in choosing plants, 
(Example 8.1), 187-8; in scale T‘c*ading, 
(Example 8.2), 188 ; in reading randomising 
maciiine, (Example 8.3), 189; in crop- 
reporting, (Example 8.4), 189-90. 

Binomial distribution, general propt^rties, 116-20 ; 
moments of, 117, (Example 3.2), 62 ; dis¬ 
tribution fimction of, 119-20 ; and 
of, (Exam^ile 3.17), 82 ; factorial moments 
of, (Exercisi^ 3.6), 87 ; limiting form, 

(Example 4.(5), 103 ; arising from mixed 
population, 122-4; with negative index, 
125-6 and (Exercise 6.7), 136 ; bivariate 
form, 133-4 ; cumulants of, (Exercise 6.1), 
135 ; ineornfileto moments of, (Exercises 
6.2 and 5.3), 135 ; in sampling of attributes, 
198 ; distribution of means of, (Example 
10.8), 243. 

Birth-rates, distribution of in Ix)cal Government 
Ai-eas, (Table 1.1), 3; frequency polygon 
of, (Table l.l), 4. 

Biserial ?/, 356-8. 

Bivariate binomial di.stribution, 133-4. 

- frtxpioney-distributions, 19-22. 

- moments and cumulants, 79-81 ; standard 

errors of, 211 ; ^-statistics and cumulants, 
281- 3. 

- normal distribution, 22 ; (Example 3.16), 

79-80; moments of, (Exercise 3.16), 89; 
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&s limit of bivariate binomiab 133-4; 
correlation and regression of, 334-6 ; multi¬ 
variate form, 376-7. 

Bivariate Poisson distribution, (Exercise 6.8), 136. 

Borel, E., refs., Traite du Oalcul des ProbabUites, 
22, 183. 

Bortkiewicz, L. von, data from on suicide, (Table 
1.6), 7. 

Bose, iS. S., distributioxi of variance ratio, (Exer¬ 
cise 14.8), 365. 

Bowley, A. L., refs., F, Y. Edgeworth's Contribu¬ 
tions to Mathematical Statistics, 160 ; repre¬ 
sentative method, 202. 

Brood-mares, distribution of fecimdity in, (Table 
1.20), 24. 

Call discoiuit rate, disti'ibution of wwkly returns 
according to, (Table 1.26), 28. 

Camp, B. H,, refs., distribution functions of bi¬ 
nomial and bypergeometne, 134. 

Card-shufBing, tested by (Example 12.1), 297-9 ; 
tested by rankings, (Examjile 16.5), 420. 

Carleman, T., criteria for uniqueness in the prob¬ 
lem of moments, 109 ; refs., Lcs fonctiems 
qvmi-analytlques, 114. 

Carver, H. C,, Sheppard corrections for discrete) 
variables, 86. 

Cauchy distribution, (Examplt> 3.12), 67-8 ; char¬ 
acteristic function of, (Examx)lo 4,2), 95-6 ; 
distribution of moan of samples from, 
(Example 10.1), 233 -4 and (Example 10.1.6), 
247. 

Cave, B. M., refs,, sanqiling of correlation co- 
afficiont (under Co-operative Study), 363. 

CVnsus of Population, data from Housing Kefiort, 
(Table 1.24), 27. 

- of Production, data from, on size of firms, 

(Table 1.17), 23. 

Central Limit Thoorom, 180-3. 

Characteristic fimctions, as moment-general mg 
functions, 64; general theory of, 90“ 115: 
limiting properties of, 99-104 ; multi¬ 
variate, 104-5 ; conditions for a function 
to be, 98-9 ; in sampling distributions, 
242-6. 

Charlier, C. V. L., Types A and B series, 147 (see 
Grani-Cliarlier series) ; refs., expansion of 
frequency functions, J60, 

Cheshire, L., refs., significance of correlation co¬ 
efficient, (under E. S. Pearson), 363. 

Chi-square, sm 

;c2-distribution; generally, 290-307 ; praj>ertk»s 
of, 292-7 ; in 2 X 2 tables, 303 ; oorr<'ction 
for continuity, 303-4; as square con¬ 
tingency, 319. 

Cholera, inoculation against, (Table 12.6), 302; 
(Example 13.1), 309; (Example 13.2), 
311-12; (Example 13.3), 313. 


Church, A. E. R,, sampling moments, 266; r©fo.> 
284-6. 

Circular triads, in preferences, 423. 

Class-frequency, definition, 2. 

Class-interval, definition, 2 ; ambiguities in, 5. 

Cloudiness, distribution of days according to, 
(Table Lll), 10. 

Cochran, W. G., refs., 305 ^ 

“ Cocked-hatas synonym for unimodal, 29. 

Coefficients of association, contingency, correlation, 
etc., see under Association, Oontingoncy, 
Corrolatioii, eto. 

Coin-tossing, as example of sampling of attributes, 
(Example 8.9), 198. 

Colligation, coefficient of, 311. 

Combinatorial method, in sampling of A*-statistics, 
see A-statistics. 

ComparLSons, paired, sec Paired comparisons. 

Comrie, J., refs.. Tables of arc tan .r and log 
(1 4- -1-2), 160. 

Concentration, coefficient of, 43 ; curve of, 43—4 
and (Figure 2.3), 44. 

Concordance, eoeffieieiit of, 411; see also m 
rankings. 

Consistence, (‘oefficieiit of, 426. 

Contingency, 318-22 ; coefficient of, 319. 

Continuity eorreetion to yfs 303-5. * 

(’oiitinuous fr(‘quency functions, 13 ; sampling 
from, 197. 

Continuum, probability in, 170. 

Co-operative Study on corri'lation coefficient, refs., 
,363. 

Cornish, E. A., refs., moments and cumulants in 
specification of distributions, 100. 

Corrections for grouping in calculation of moments, 
30, 41 ; whem distributiun is abrupt, 79, 
refs., 86-6 ; see also Sheppard’s corn‘ctioris. 

Corneal ion, co(4ficient of yiroduct-moment, gener¬ 
ally, 321—67; definition, 329; calculation 
of, 330-4 ; in bivariate normal distribution, 
334 ; sampling of, 336—48 ; standard error 
of, (Example 9.6), 211 ; Fisher’s trans¬ 
formation of, 345 ; tables of (David), 346, 

-coefficient of multiple correlation, 380-1 ; 

samyiling of, 381 5. 

-coefficient of yjartial, 368- 79 ; definition, 

370 ; in terms of coefficients of lower ordet’s, 
372 ; geometrical interpretation, 372-3 ; 
examples of, (weather and croyjs, Example 

16.1) , 373-5, (crime and religion, Example 

16.2) , 375-6; in multivariate normal dis¬ 
tribution, 376 “8 ; sampling distribution of, 
378 9. 

- intra-olass, 368-62. 

-raiffi, generally, 388- 421 ; Spearman’s co¬ 
efficient, 388-91 ; sampling of, 394-403; 
coefficient t, 391-3 ; sampling of, 403-8. 
See also m rankings. 
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Comlatlon ratios, definition, 351; sampling dis«> 
tribution in lanoorrelated normal popiilation, 
352-3 ; relation with multiple correlation, 
381 ; for ranked data (Wallis), 437. 

Covariance, definition, 79; notation for, 204; 
calculation of, 330; distribution of in 
normal samples, 339-42. 

Cows, distribution of according to age and milk- 
yield, (Table 1.25), 27. 

Craig, C. C., corrections to moments of discrete 
distribution, 77, refs., 85; (Exercise 3.13), 
88; sampling of oumulants, 266, refs., 
285. 

Cramer, H., convergence of Gram-Charlier series, 
151~2,169, refs., 160 ; central limit theorem, 
181-3 ; distribution of a ratio (Exercise 
10.8), 262; refs., Random Variable$ and 
Probability DietribiUions, 114, 183, 260. 

Crime and alcoholism, G©ring’s data on, (Table 
14.6), 366. 

- correlation with religion, (Example 15.2), 

376. 

Crop-reporters, bias in, (Example 8.4), 189-90. 

Crops,. correlation with weather, (Example 16.1), 
373. 

Cuckoo’s eggs, distribution of length of, (Exercise 
14.13), 366. 

Cumulants, definition, 60 ; invariantive projwties 
of, 61 ; relations with moments, 61-4; 
existence of, 64-6 ; calculation of, 66-8 ; 
in bivariate case, 80 ; Sheppard’s correc¬ 
tions to, 78 and (multivariate case) 80-1 ; 
generating functions for, 90 ; of normal 
distribution, 129. 

Cumulative function, 90. 

Curve pf concentration, see Concentration. 

Dairy farms, distribution according to costs of 
milk-production, (Table 1.9), 9. 

David, F. N., distribution of difference of Type 
III variates, (Exercise 10.6), 262 ; Tables 
of the Correlation Coefficient^ 346, refs., 
363. 

Davies, O. L., refs., estimation of standard devia¬ 
tion, 228. 

Deaf-mutes, distribution of childi'en of, (Table 
1.19), 24. 

Deaths, from scarlet fever, (Table 1.3), 5 ; dis¬ 
tribution of, according to age at death, 
(Table 1.12), 11. 

Deciles, definition, 36; interdocile range, 38; 
standard errors of, 226. 

de Finetti, B., refs., calculation of mean diffen3nce, 
47. 

Degrees of freedom, in -distribution, 292; in 
contingency table, 299. 

d© la VaU6e Poussin, C. J., refs., Cours d^analyse, 
footnote, 233. 

A.S. 


Demoivre, A., discoverer of normal distribution, 

131. 

Denjoy, A., theorem on uniqueness of quasi- 
analytic functions, (Exercise 4,10), 116. 

Dice, throws with, Weldon’s data (Table 1.14), 19 ; 
(Table 1,16), 23; (Example 8.10), 199; 
(Table 12.6), 301. 

Digits, distribution of, from telephone directory, 
(Table 1.4), 6. 

Direct probability, see Probability. 

Dirichlet integrals, in Inversion Theorem, 91-2. 

Discontinuous frequency-functions, 12. 

- variate, examples of distribution according 

to, 6-7. 

Dispersion, measures of, 38-48 ; see also Standard 
Deviation. 

Distribution curve, 36'-7. 

-functions, 12-16 ; determined by clxaractor- 

istic function, 91-4 ; limiting proj>ertios of, 
99-104, 110-13; detonnination by mo¬ 
ments, 105-10 ; t standard distributions, 
116-63, ace also Standard Distributions ; 
relation with probability, 172-3. 

Doodson, A. T., relation of mean, median and 
mode, 36, 46 ; refs., 47. 

D6rgo, K., refs., axiomatisation of von Mises’ 
theory of probability, 183. 

Drossel, P. L., refe,, serninvariants, 84-6, 285. 

Edgeworth, F. Y., citing Weldon’s dice data, 
(Table 1.14), 19 ; form of Gram-C^harlier 
series, 148-9 ; refs., law of error, 160. 

Edwards, J., refs., Integral Calculus^ footnote, 68 
and footnote, 221. 

Eells, W. C., formulae for probable errors of 
correlation coefficients, 410, refs., 436. 

Egyptian skulls, distribution of, (Table 1.22), 
25. 

Elderton, E. M., data on health of son and alcohol¬ 
ism of father, (Exercise 14.12), 366. 

Elderton, Sir William P., Hardy’s method of calcu¬ 
lating factorial moments, 69 ; corrections 
for moments when the distribution is sym¬ 
metrical, 85 and (Exercise 3.10), 87-8 ; 
fitting of Pearson distributions, 143 ; on 
Gram-Charlier series, 153 ; tables of 293 ; 
refs., Frequency Curves and Correlation^ 86, 
160. 

Error, standard, see Standai’d Error. 

Estiinates, of proportions of attributes, 199-200 ; 
in large samples generally, 201-3 ; of a 
ranking, 421. 

Euler-Maclaurin sum formula, 69. 

Expectation, 84. See also Moan Values. 

Extreme values of sample, distribution of, 217-22. 

Eye-colour, relation with hair-colour, (Example 

12.3) , 299 ; in parent and child, (Example 

13.4) , 314. 
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FiMrtoridi 50; ia 

terms of ordinary monnents, 57-$; ealou- 
lation of, 5$-60; oorrectionB 

to, 77-8 ; generating ftmotim for, 90; of 
bmomial, 118 5 of liypergeometrio, (Exer- 
oise d.4), 135. 

Families deficient in room i^mce, distribution of, 
(Table IM), Z7. 

Fonel, 3,f theorem on distribution of digits in 
mathematieal tables, footnote, 193. 

Fathers, height of, distribution of sons according 
to, (Table 14.3), 327. 

Fay, B. A., data from Marriages of the Deaf in 
America, (Table 1.19), 24. 

Fecundity, distribution of brood-mares according 
to, (Table 1.20), 24. 

Feeding and teeth in infants, (Example 12.5), 304. 

Fieller, E. C., refs, distribution of a ratio, 250. 

Filon, L. N. G,, refs, (under Pearson), standard 
errors of Itoquenoy constants, 229. 

Finite populations, sampling from, 283-4. 

Finney, D. J., sampling of variance ratio, (Exercise 
14.8), 365. 

Firms in the Food, Drink and Tobacco Trades, 
distribution of, (Table 1.17), 23. 

First hiuids at whist, distribution of, (Tabic 5.4), 
128; (Example 12.1), 299-300. 

First Limit Theorem, 100-1 ; converse of, 101-3. 

Fisher, Ame, modified form of Gram*Qiarlier 
series, 153; fitting of Type B to data 
(Example 6.4), 156; refs., Frequency 

Curves, 160- 

Fislior, R. A„ Sheppard’s oorroetions, 75-7; 
intiKKiuction of word “ cumulant,” 85; 
random sampling numbers, 194, 197 ; dis¬ 
tribution of mean deviation, 216 ; dis^ 
tributicm of extreme, 220 ; 2 ;-distribution, 
see js-distribution ; /fc-statistics, 266, 268 ; 
measures of departure from normality, 
(Exercise 11.16),^ 289 ; tables of 293 ; 
normal approximation to x*» 294-5 ; dis¬ 
tribution of x^ when parameter estimatefl 
from data, 301 ; distribution of variances 
and covariance in normal samples, 340; 
transformation of correlation coefficient, 
346; distribution of multiple correlation 
eoefiScicnt (Exercises 15.6 and 16.7), 387 ; 
refs., moments and cumulants in specifica¬ 
tion of distributionB, 160; mathematics of 
statistics, 184; inverse probability, 184; 
distribution of mean deviation, 228 ; dis¬ 
tribution of extreme values, 228 ; distribu¬ 
tion of correlation coefficient, 260, 363; 
distribution of well-known statistics, 250 ; 
applications of Student’s distribution, 260 % 
ib-statistics, 286 ; distribution of x^^ ^0 i 
distriburiun of partial coefficients, 386; 
distribution of multiple correlation, 886. 


Food, I>rinfc and Tobacco TmdeC^ distribiitlon of 
firms, (Table 1.17), 21 

Footmle, Spearman’s, 436, 

Fr4ch©t, M., proof of Second Limit Theorem, U2, 

113, refit., 114. 

Frequency (oiass-lrequency), definition of, 2, 

Frequenoy-'distributions, gmerally, 1-28 ; genesis 
of, 18. 

Frequenoy-fimctions, 12-16; discontinuous, 12; 
determined by characteristic fvmotion, 91-4; 
normalisation of, 166-9. 

Frequency-polygons, 4 ; bivariate form, 20. 

Friedman, M., tests of significance in m rankings, 
420, refs., 436. 

Frisch, R„ moments of binomial, 68 and (Exercis© 
5.3) 135 ; refs., moments and oumulonts, 
86, 134 ; correlation analysis, 386. 

Gaibnm, H., convergence of Gram-Charlier series, 
162. 

Galton, Sir Francis, data from Natural InkerUcmce, 
(Example' 13.4), 314 ; correlation, 363, 

Gabon’s ogive, see Distribution curve. 

Galvani, L., refs, (under Gini), me'dian for qualita¬ 
tive charactc'ristics, 47. 

Vi (skewness and kurtosis), 82. 

jT-function, in summing Poisson series, 122. 

Garwood, F., data from, (Table 12.1), 297-8; 
refs., fiducial limits for Poisson distribution, 
305. 

Geary, R. C., distribution of measures of departme 
from normality, (Exercise 11.16), 289; 
distribution of a ratio, (Exercise 10.9), 253 
and refs., 250. 

Geiger, H., see Kutherlbrd. 

Generating fimctions, for moments and cumulants, 
90. See also Characteristic functions. 

Geometric mean, see Mean, geometric. 

German women, distribution of suicides, (Table 

1.6) , 7. 

Oilby, W. H.. data from, on intelligence and 
clothing in schoolchildren, (Table 13.1), 320. 

Gini, C., coefficient of conctmtration, 43; co¬ 
efficient of mean difference, 42 ; standard 
error, 216, 225 ; refs., mean difference, 47 ; 
median for qualitative charaoteristios, 47. 

Glossina morsitans (tsetse fly), distribution of 
trypanosomes in, (Table 1.13), 12. 

Gwing, C., data on alcoholism and crime, (Table 

14.6) , 366. 

Gosset, W. S., see ** Student.” 

Grades, 408 ; relation with ranks, 408-10. 

Graduation curve, see Distribution curve. 

Grain, distribution of plots according to yield of, 
(Table 1.18), 23. 

Gram-Cliarlier series, Typo A, 147-54; Edge¬ 
worth’s form, 148-50; fitting to bean 
data, (Example 6.2), 151; distribution of 
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mc«wiB from, (Exercise 10.7), 252 ; Type B, 
154-0 ; Type 0, 160. 

Greenwood, M., data on industrial oooidetits, 
(Table 5.3), 124; on inociilation against 
cholera, (Example 13.1), 309. 

Groiiping of frequency-distributions, corrections 
for, see. Sheppard’s con’octions. 

Gmnbel, E, J., distribution of rath valueis, 220-2 
and refs., 228. 


Haines, J., refs, (under Poarsou), rise of range, 228. 

Hair-colour, relation with eye-colour, (Example 
12.3), 299-300. 

Haldane, J. B. S., refs., cumulants and moments 
of binomial, 134 and (Exorcise? 6.1), 135 ; 
y} with small expectations, 305 ; normalisa¬ 
tion of frequency fimctions, 305 and (Exer¬ 
cise 12.1), 306. 

Half-invariants (seminvariants), see Cumulants. 

Hall, Sir A. D., data on yield of grain, (Table 1.J8), 
23. 

Ha’l, P., lefs. distribution of rueixn from rectangular 
population, 250 ; multi))]e correlation, 386. 

Hauiburg(T, H., jirobltmi of moments, 107 and 
refs., 114. 

Hardy, Sir U. F., calculation of factorial moments, 
59. 

Harmonic mean, see Mean, Harmonic. 

Haiiley, H. ()., distribution of range, 224 and 
r(‘fs., 228. 

floaltli of son and alcoholism of j)ar(*nt, (Exercise 
11.12), 360. 

Height, distribution of men according to, (Table 
1.7), 8 ; fre(|uency-polygon of, (Figure 1.3), 
8; mean, (Examj)le 2.1), 30-1 ; median, 
(Example 2.4), 35 ; quartiles, (Example 
2.5), 36 ; distribution curve, (Figure 2.2), 
37 ; moan df^viation aiul standard devia¬ 
tion, (Example 2.6), 39-40 ; mean differ¬ 
ence, (Example 2.8), 45-6 ; factorial luid 
ordinary monumts (Example 3.7), 59 60 ; 
tilted to normal curve, (Table 5.5), 132; 
standard error of mean, (Example 9.1), 207 

-in fathers and sons, (Table 14.3), 327 ; 

correlation, (Example 14.3), 337. 

-, distribution of jfants ac'cordiiig to, (Table 

8.1), 187. 

Heilman, M., data on teeth and fettling in infants, 
(Example 12.5), 304. 

Kelly, W., theorems on convergent st^quemccjs of 
functions, 100, 112. 

Hehnert, W., distribution of mean deviation, 215 ; 
distribxition of sums of squares, 250, 305. 

Henderson, J., refs., expansion in tetnichoric 
fimctions, 160. 

Hormitc, C., polynomials, 145, 160. See Tcheby- 
cheff-Hennite polynomials. 


Heron, D., refs, (imder Fearsem), cocfiicients of 
association, 322. 

Heterotypic frcqxicn^y-distributions, 145, 

Highest audible pitch and age, bivariate distribu¬ 
tion according to, (Table 14.1), 325 ; corre¬ 
lations and regressions, (Example 14-1), 
331 ; correlation ratios (Example 14.11), 
361 «^ 2 . 

Hdferty, M. M., limiting distribution of 294--6 
and refs, (under Wilson), 306. 

Hilton, J., refs., inquiry by sample, 202. 

Histogram, 4 ; bivariate, 20. 

Hojo, T., refs., distribution of median, quartiles 
ami somi-iutorquartile range, 228. 

Homoscedastic distributions, 335. 

Hooker, R. H., data on weather and crops, 
(Example 15.1), 373 and refe., 386. 

Hotelling, H., distribution of Speanmn’s p, 401 
and refs., 430. 

Hsu, 0. T., sampling cumulants of normal dis- 
trilration, 275 and refs., 285. 

Hypergeometric distribution, generally, 126-8; 
moments of, 127 ; example of, (Table 6.4), 
128 ; factorial moments of, (Exercjse 6.4), 
135 ; limiting forms of, 132-3. 

- function, 127. 

Hypothetical population, 187. 


Illusory association, 317. 

Income, distribution of persons by, (3’able 1.2), 3 ; 
histogram of, (Figure 1.2), 4 ; distribution 
curve of, (Figure 2.1), 37. 

Incomplete moments, 43 ; of binomial, refs., 134 
and (Exercises 5.2, 5.3), 135. 

Iiid('penderice, definition, 21 ; in asbociation tables, 
309 ; in bivariate frequency tables, 326. 

Index, distribution of, sec Ratio. 

Induction, m finding sampling distributions, 
246-8. 

Inequalities for riioim'nts, 56 ; refs. (Shohat), 86 ; 
Liajiounoff’s, 56 and (Exercise 3.14), 88. 

Inoculation against cholera, sec Cholera. 

——' against tubt^‘reuloHis in cattle, (Exercise 12.7), 
307. 

Intelligence, distribution of schoolchildren accord¬ 
ing to, (Example 13.6), 320. 

Interdecile range, 38. 

Interquartile range, 38 ; standard error of semi- 
interquartile range, (Example 9.8), 214. 

Interval (class-interval), see under Claas. 

Intra-class correlation, 358-62. 

Inverse probability, 176 ; see Hayc's’ theorem. 

Invei'sion th(jor(*m, 91-8 ; examples of use of, 
94-8. 

Iii’ogular Kollektiv of von Mises, 171-2. 

Irwin, J. (>., distribution of means, (Exercises 
10.3 ai^d 10.4), 251 and refs., 251. 

GO* 
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d^ifitvibuiioxi, 10. 

Jaokdon^ Dimham, on mdotamii»«iey of median, 
45 and refs^^ 47. 

H#, logic of probability, 165; refs., 
Theorp of Pro6aWi%, 184. 

Jensen, A., refs., representative method in 
statistics, 202. 

Johannsen, W., bean data cited by Pretorius, 
(Table 1.16), 20, 

Johnson, W. K., logic of probability, 166; refs., 
LogiCt 1B4. 

Jordan, C., refe., SiatMqm mathemcUique, 160; 
Type B series (Exercises 6,4 and 6.6), 161- 2. 

Jorgensen, N. B-, tables of Tchebycheff-Hemute 
polynomials, 147, 151 ; rofs,, Undersopeher 
ow Fre^quensflader og Korrdation, 160. 

l;-statistios, definition 256; general properties, 
266-60 ; sampling oumulants of, 260-89 ; 
in multivariate case, 281-3. 

If, as criterion of type in Pearson distributions, 140. 

Kelley, T. I., tables of x** 293 ; tables of correla¬ 
tion coefficient, 375 and rofe,, 386 ; refs., 
Kelley Statistical Tables^ 386. 

Kendall, M. G., data from, (Table 1,4), 6 ; Shep¬ 
pard corrections, 76 ; multivariate cumu- 
lants, 80; randomness, 172; maximum 
likelihood, 179 ; data from, (Table 8.3), 189 ; 
Bandom Sampling Numbers, 193, 197; 
refs., Sheppard corrections, 86; multi¬ 
variate sampling formulae, 86; random¬ 
ness, 184; maximum likelihood, 184; 
ramdomnesB and random sampling numbers, 
202; A;-8tatistics, 285; rank correlation 
and paired comparisons, 436. 

Kendall, 8. F. H,, refs., distribution of Spearman’s 
/), 4S6. 

Keynes^ J* M., (now Lord Keynes), on probability, 
166; refs.. Treatise on Probability^ 184, 

Kiser, C, V., refs., pitfalls in sampling, 202. 

Koga, Y., data from, (Table 14.1), 325. 

Kottektiv of von Mises, 171-2. 

Kolmogoroffi, A., probability as abstract ensembles, 
166; refs., Grundbegriffc der WahrschHn- 
lichkeUstheorie^ 184. 

Kondo, T., refs., standard error of mean square 
contingency, 321, 322. 

KuUback, S., refo., distributions and cliaracteristio 
functions, 251, 363 ; and (Exercises 10.2 
and 10.6) 251, 262, (Exercise 14.7), 364-6. 

Kurto^is, 82. 

ILaplaoe, P, S. (Marquis de), oharaoteristio func¬ 
tions, 113; continued fraction for the 
normal distribution, 129-30; succession 
rule (Example 7.7), 177 ; early work on 
Central Limit Theorem, 180. 


laige samples^ apiwxteationa in ihtmj of, 201^^. 
See Standard Error. 

Laterality of haaid and eye, (Exercise 13.6), 323. 
Latter, O. data on length of cuckoo’s eg^, 
(Exercise 14.13), 366. 

Lawiey, D. N., sampling cumulants of ib-statistios, 
275 and refs, (imder Hsu), 286. 

Least squares, in determination of regression lines, 
328-9, 368. 

Lee, A., data from, on fecundity of mares, (Table 
1.20), 24 ; on stature of fathers and sons, 
(Table 14.3), 327 ; refs., sampling of correla¬ 
tion coefficient, (imder Co-operative Study), 
363. 

Legendre, P. A. M., distribution of mean from 
rectangular population, 260. 

Leibniz, G. W., logic of probabilities, 165. 

Leptokurtosis, 82. 

L^vy, P., rofs., Cahul des FrohahUitis, 22, 184 ; 
characteristic functions, 113, 114. 

Liapounoff, A., inequality for moments, 56 and 
(Exercise 3.14), 88 ; proof of Central Limit 
Theorem, 180, 183 ; refs., limit theorems in 
probability, 184. 

Likehhood, 176 ; principle of maxiiniun likelihood, 
178-80 ; in estimating proportion of attri¬ 
butes, 199-200; relation with Bayes’ 
theorem, 178-80 and (Exercise 8.5), 203. 

Limit theorems for distributions, see First Limit 
Theorem, Second Limit Theorem. 

Lindeberg, J. W., condition for validity of CVntral 
Limit Theorem, 181. 

Linear regression, 327-9, 368* 76. 

Location, measures of, 29-38. See Mean, etc, 

LotU*ry sampling, 192. 

m rankings, 410-21. 

Macaulay’s essays, distribution of sentence length 
in, (Table 1.21), 25. 

Male births, distribution of registration districts 
according to, (Table 14.2), 326 ; constants 
of, (Example 14.2), 364. 

Malocclusion of teeth in infants, (Example 12.5)) 
304. 

Markoff, A., refs.. Second Limit Theorem. 113. 

Marriages, distribution of Australian, see Aus¬ 
tralian ; of deaf in America, (Table 1.19), 
24. 

Martin, E. S., refs., corrections to moments, 86. 

Maximum likelihood, 178* Se^ Likelihood. 

Mean, arithmetic, dehnition of, 29 ; properties of, 
32; relation with median and mode, 36, 
46; as first moment, 39; standard error 
of, 224 ; distribution of, in normal samples, 
(Example 10.6), 238-9; in rectangular 
samples (Examples 10.7 and 10.12), 240-2, 
244; in Poisson distribution, (Example 
10,9), 243; in binomial, (Example 10.8), 
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in IVpse HI dfatiibution (Ebcample 

mu), m 

Maan deviation* abont in^an* 33; about median, 
38 1 standard error of, 215. 
c1i5rermee» 42; oalonlation of^ 46 and (Exer¬ 
cise 2.10) 48 ; standard error, 216-17, 226. 

——, geometric, 32; less than arithmetic mean, 
83 hI ; distribution of, 246-6 ; from rect¬ 
angular population, (Example 10.13), 246 ; 
from Type HI distribution (Exercise 10.2), 
251. 

-, harmonic, 32 ; loss than arithmetic and 

geometric means, 33-4. 

- square contingency, 319. 

-- values, 84 ; in sampling problems, 264—6. 

Measur<*s of location, dispersion and skewness, 
29-48, 81-2. 

Median, 34 ; relation with mean and mode, 35, 
46 ; standard error of (Example 9.7), 213, 
225. 

Mohler, G., refs., expansion in tetrachoric series, 
363. 

Mendelian law. test of, as sampling of attributes, 
197-8 ; in pea breeding. (Example 12.2), 
299. 

Merc(M‘, W., data from, (Table 1.18), 23. * 

Merzralh, E., refs., bivariate frequencyntistribu- 
tions and correlation, 85. 

Mesokurtosis, 82 ; in normal distribution, 129. 

Milk, costs of production of, (Table 1,9), 9. 

Milk-yield, distribution of cows according to, 
(T'able 1.26), 27 ; covariance and variances, 
{P3xercise 14.1), 364. 

Milne-Thomson, L. M., Calculus of Finite Differ- 
oicest footnote, 69. 

Miner, 5. R., tables of correlation coefficients, 375 
and refs,, 386. 

Mises, R. von, probability as limit in sequences, 
165, 171-2; refs., WalirscheinlichkeiX^ 8ta- 
iistik und Walirheit, 184. 

Mode, 35 ; relation with median and mean, 35, 
46 ; standard error in Pearson distributions, 
22.5. 

Moments, preliminary, 39 ; Sheppard’s corrections 
to, 41 ; definition, 49 ; about one point in 
terms of those about another, 49 ; calcula¬ 
tion of, 56-4; generating functions for, 
54-6, 90 ; absolute moments, see Absolute ; 
factorial moments, see Factorial; in terms 
of factorial moments, 67-8 ; relationslup 
with cumulants, 61-4; corrections for 
grouping, 68-78; multivariate, 79-80; 
corrections to multivariate, 80-1; as 
characteristics of a distribution, 83-4; 
problem of moments^ 106-10 ; of binomial, 
117, 118; of hypergeomotric, 127; of 
normal distribution, 129; standard errors 
of, 204r-ll, 226 ; distribution of, 246. See 


also Sheppard^ ooitcctiotas, Second limit 
Theorem, Cktmulaiits. 

Montel, F., theorem on convergent sequences of 

; functions, 100. 

Moore, G., data from, ctable 1.20), 24, 

Morant, G., refs., random occumnoes m space and 
time, 134; data from (Table 14.1), 326. 

mth values, distribution of, 217-22. 

Multiple correlation, see Correlation, 

Multivariate ; distributions, 19-22 ; normal dis^ 
tribution, 376-7 ; sampling distributions, 
260; correlation, see Correlation; mo¬ 
ments and cumulants, 79-81 ; character¬ 
istic functions, 104-6 ; Ij-statistics, 281-3. 

Nair, U. S., distribution of mean difference, 216, 
226 and refs.', 228. 

Neyman, J., on theory of estimation, footnote, 
180; refs., estimation, 184; representa¬ 
tive method, 202 ; sampling from finite 
population, 284, 285. 

Nicholson, C., refs., distribution of a ratio, 251. 

Normal distribution, generally, 128' 32 ; moments 
of, (Example 3.4), 63-4; evunulants of, 
(Example 3.10), 67 ; providing standard of 
kurtosis, 82; characteristic function of, 
(Example 4.1), 94 ; as limit of binomial, 
(Example 4.6), 103 ; determined uniquely 
by its moments, (Example 4.7), 109-10; 
OH limit of Poisson distribution, (Example 
4.8), 113 ; distribution function of, 129-30 ; 
as one of Pearson’s typos, 141 ; in Central 
Limit Theorem, 180-3; in sampling of 
attributes, 198-9 ; distribution of moan in 
samples from, (Example 10.2), 2^4—6, 

(Example 10.3), 236-7, (Example lO.lO), 
243 ; distribution of v^ariano© in samples 
from, (Example 10.5), 238-9 ; sampling of 
A;-Rtatistic8 from, 274; distribution of 
measures of departure from, (Exercise 
11.16), 288 ; bivariate fonn, see Bivariate ; 
multivariate form, 376-7. 

NonnaUsation of frequency-functions, 156-9. 

Norris, N., refs., inequalities among averages, 47. 

Norton, J. P., data from Statistical Studies in the 
New York Money Market, (Table 1.26), 28. 

Ogbum, W. F., correlation of crime and religion, 
(Example 16.2), 376 and refs., 386. 

Ogive of Gal ton, see L)i.stribution emve, 

Oldis, E., rt^s., signifloanoe of correlation oo* 
ofilciont, (under E. S. Pearson), 363* 

Pabst, M. R., distribution of Spearman’s p, 401, 
and refs, (under Hotelling), 436. 

Paciello, tJ., mfs., calculation of mean difference, 
47. 
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Paired comparisons, 42;l'-36, 

Pairman, K., refs., cori’ections to abmpt distri¬ 
butions, 85. 

Parameters, definition, 29 ; of location, 29-38 ; 
of dispersion, 38-48. 

Partial: association, 313“18 ; contingency, 321-2; 
correlation, see Correlation ; regression, see 
Regression. 

Pattern fimctions, in sampling ^-statistics, 262-5, 
277-8, 279, (Exercise 11.11), 287. 

Pea breeding, (Example 12,2), 299. 

Pearce, T. V., data from, (Table 1.23), 26. 

Pearse, G. E,, data from, (Table 1.11), 10; refs., 
corrections when ordinates are infinite, 86. 

Pearson, E. B., distribution of range, 223, 224 ; 
sampling of con'clation coefficient, 346; 
distribution of 280-1, (Exorcise 11.17), 
289 ; refs., range, 228 ; estimating standard 
deviation, 228 ; distribution of frequency 
constants in skew population, 228 ; tests 
for normality, 285 ; correlation coefficient, 
363 ; polychoric coefficients, (under K. 
Pearson), 363. 

Pearson, Karl, data fr<>m : trypanosomes, (Table 
1.13), 12 ; feeunclity of mares, (Table 1.20), 
24 ; whist deals, (Table 5.4), 128 ; height 
of fathers and sons, (Table 14.3), 327; 
quoting data by Goring on crime, (Table 
14.6), 356 ; quoting data by Elderton on 
alcoholism, (Exorcise 14.12), 366. 

Coefficient of variation, 43 ; moasui’C of 
skewness, 81 ; coefficient of contingency, 
319- 20; sampling of contingency coefficients, 
321 ; sampling of tetrochoric r, 350, and of 
biserial rj, 358 ; grades and Speaiman’s p, 
410. 

Refs., corrections to abrupt distributions 
(under Pairman), 85 ; skew variation, 131; 
moments of hypergeometric, 134 ; 15-con¬ 
stant frequency surface, 160; standard 
(Tfors of frequency constants, 228-9 ; mean 
character of rankeii individual, 229 ; distri¬ 
bution of 251, 305 ; of difference of Type 
Ill variates, (Exorcise 10.6), 252 ; sampling 
of contingency coefficients, 322 ; midtijile 
contingency, 322 ; sampling of cori'elation 
coefficient, (under Co-operative Study), 363 ; 
probable error of biserial ry, 363 ; ranic 
correlation, 436. 

Pearson, M. V.,- refs., mean character of ranlted 
individuals, 229. 

Pearson distributions, as limit of hyporgeomotric, 
132-3; generally, 137-45 ; reoun*ence re¬ 
lation for moments, 138 ; skewness of, 138 ; 
inflections of, 138; fitting of, 143-5; 
quadrature of, 146; generalisation by 
Romanovsky, rofs. 160, 161 ; distribution 
of means from (ref. Irwiu), 250. 


Pitman, E. J, G., refs., significance test applicable 
to samples from any population, 436. 

Platykurtosis, 82. 

Pomear6, characteristic functions, 118. 

Poisson distribution, generally, 120-2 ; cumulants 
of, (Example 6.9), 66 ; moments of, (Exer¬ 
cise 3.3), 86 ; nonnal distribution as limit¬ 
ing form of, (Example 4.8), 113 ; distribu¬ 
tion fimction of, 122 ; in mixed po]>ulations, 
122-4 ; bivariate form, (Exercise 5.8), 136 ; 
sampling of attributes from, (Exercise 8.2), 
203 ; distribution of means from, (Example 
10.9), 243. 

Polynomials, see Tchebycheff-Hermite polynomials. 

Populations, as basis of statistical theory, 1 ; 
existent, 18-19; hypothetical, 19; types 
in sampling, 186-7. 

Posterior })robabiUty, 176. 

Potatoes, bias in ontimates of yield, (Example 8.4), 
189-90. 

-and wheat, corrfNation of yields, (Table 

14.4) , 333, (Example 14.3), 332-h 

Protorius, 8. J., data from, on Australian marriages, 

(Table 1.8), 9; on beans, (Table' 1.13), 20 
and (Table 6.1), 150 ; if'fs., skew bivariat<» 
* distributions, 160. 

Principle of Maximum Likelihood, 178. See 
Likelihood. 

-of moments, 83 ; in fitting Peaisoifi'^ dis¬ 
tributions, 143. 

Prior probability, 176. 

Probability, generally, 104“ 85 ; logic of, 165; 
ba.sic rules of direct probability, 160-70 ; 
in a continuum, 170-1 ; von Mises’ ap¬ 
proach, 171 2; and statistical distributions, 
172 3 ; Hayes’ theorem, 175-8; inverse 
probability, 176 ; posterioi and prior, 176. 

-fimctions, 14. 

iVoblem of moments, 105 10 ; refs. 113 14. 

Produet-moim'lit correlatK>n, see Correlation. 

Quadrature of Pearson distributions, 145. 

Quantiles, definition, 30 ; graphical deti*nniiia- 
tion of, 37 8 ; standard erroi’S of, 211-13. 

Quartiles, definition, 36 ; interquartile range as 
measurp of dispersion, 38 ; standard (Trors 
of, 225. 

Radioactive element (polonium), distribution of 
particles from, (Table' 6,2), 155, (Example 

6.4) , 156. 

Ramsey, F. P., lf)gic of probability, 165; re^fs.. 
The Foundations of Mathematics, 1S4. 

Random variables, definition, 173 ; addition of, 
173. 

- Sampling Nuinbc^rs, 192-7. 

Randomising macliino, (Example 8.3), 189. 
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Eattdpmnefiw, 171 ; random sampling, generally, 
t technique of, 191-7. 

Bange, dednition, 38 ; distribution of, 223-4. 

Bank correlation, see Correlation. 

Ilianking, estimation of, 421. 

Bankings, problem of w, see m rankings. 

Ratio, distribution of, 248-9 ; Cramer’s theorem 
(Exercise 10.8), 252; Geary’s theorem 
(Exercise 10.9), 253 ; refs., 250-1. 

Rectangular population, transformation of fre¬ 
quency-distribution to, 18 ; as one of 
Pearson’s distribxitions, 142 ; distribution 
of moan of samples from, (Example 10.7), 
240 and (Example 10.12), 244 ; distribu¬ 
tion of g€?ometric mean in samples from, 
(Example 10.13), 245-0. 

Reem’ronc(‘ relations for moments of binomial, 118. 

Registrar‘General’s Statistical Review of England 
and Wales, data from, (Table 1.1), .3; 
(Table 1.3), 5; (Table 1.11), U. 

Kogistrat/ion districts, distribution according io 
births, (Table 14.2), 326. 

Regression, definition, 327 9 ; coefficients of, 329 ; 
criterion for linearity of, 335- 6 ; sampling 
of coefficients of, 336-7, 347-9; standard 
error of coefficients, 337 ; signiticance of, 
358-9; partials, 368-79; sampling of 
})artials, 378 9. 

Religion, correlation with crime, (Example 15.2), 
375-6. 

Rescr\fvs and bank deposits, distribution of, 
(I’able 1.26), 28. 

Residuals, in regression equations, 369. 

Ritchie-Scott, A., refs., correlation coefficient of 
polychoric table, 363. 

Romanovsky, V., refs., method of moments, 86 ; 
moments of byp(*igeometric, 134 and (Exer¬ 
cise 5.2), 135; generalisation of Pearson 
distributions, 1(50. 

Roorn-siiace, distribution of families dt'ficii'nt in, 
(Table 1.24), 27. 

Rot/hainsted Expi^rimental Station, data from, 
(Table 8.1), 187. 

Rutherforil, Lord, data on (‘mission of radioactive 
particles, (Example 6.4), 156. 

St. Georgoscu, N., refs., sampling moments, 286. 

Saltms, in distribution function, 14, 

Sampling, prelimular 5 ^ 174 ; simple, 174 ; random 
sampling, see Random ; sampling problem, 
186 ; with and without replacement, 186-7 ; 
randomness in, 187-97 ; lottery or ticket, 
192; from continuous populat ion, 197 ; 
from attributes, 197-202. 

-distributions, 173-5; role in sampling 

problems, 201 ; exact, 231-53 ; derivation 
by analytical methods, 231-6, by geo¬ 
metrical methods, 236-42, by charactenstio 


functions, 242-6, by induction, 246 -8 ; of 
a sum, 240-7 ; of a ratio, 248-9 ; multi¬ 
variate, 250 ; approximations to, 254-*89. 

Sampling moments, generally, 254-89. See Cumu- 
lonts, A;-8tatistic8. 

Scale reading, bios in, (Example 8.2), 188. 

Scarlet fever, deaths from, (Table 1.3), 5. 

Schoolchildren, distribution according to intelli¬ 
gence and ok^thing, (Example 13.6), 320. 

Second Limit Tlieorem, 110-13. 

Semi-interquartiU* range, as measure of skewness, 
38 ; standard enor of, 215. 

Seminvariant statistics, 84-5, 256, refs. (Drcssel 
and Kendall), 285. 

Seminvariants, 61, 84-5, refs., 84-5. See Oumu- 
lants. 

Sentences, distribution of according to length, 
(Table 1.21), 25. 

Sheppard, W. F., tables of normal distribution, 
130 and refs., 134; correlation coefficient, 
(Exercise 14.4), 364. 

Sheppard’s corrections, 68-74 ; as orago cor¬ 
rections, 74-5; for discrete data, 77, 
(l^^xercise 3.13), 88 ; to factorial moments, 
77-8 ; to eumulants, 78 ; multivariate 
case, 80-1 ; compared with sampling 
fluctuations, 210. 

Shirky popjnes, distribution of, (Table 1.5), 7. 

Shohat, J., refs., Stielt jes integrals, 22 ; inequalities 
for moments, 86 ; Second Limit Theorem, 
112, 113, 114. 

Shuffling of cards, s(e Card-Bbuffiing. 

Simple sampling, 174. 

Skew dist ri but ions, 1 0 . 

Skewness, 10 ; measures of, 81-2 ; of Pearson 
distributions, 138 ; standard error of, 225. 

Skulls, Kgy]>tian, distribution of, (Table 1.22), 25. 

Sons, distribution of according to stature, (Table 
14.3), 327. 

Soper, H. K., refs., Frequency Arrays^ 134 ; 
sampling of correlation co(dlici(^nt (under 
Co-operative Study), 363. 

Spahlinge>r vaccine, data on, (Exercise 12.7), 307. 

Speannan, coefficient of rank correlation, 

388-91 ; sampling of, 394-403 ; footrule, 
436 ; refs., rank correlation, 436. 

Square contingency, 319. See 

Standard deviation, 39 ; standard error of, 224. 

-Distributions, 116-36, 137-63. /See wyier 

Binomial, Hyporgeometric, Poisson, Nor¬ 
mal, Pearson distributions, Gram-Charlier 
seiios. Normalisation of frequency-func¬ 
tions. 

- errors, 199 ; in attributes, 199-201 ; gener¬ 
ally, 204-30; compared with Sheppard 
corrections, 210; of sum and difference, 
226. (For standard errors of particular 
statistics, see under those statistics.) 
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Stwdflwpcl ; affect <m cumultots of trane- 

formati<wi to, ; on characti^mtic func¬ 
tion pf tramfbi*mation to, (Example 4.6), 
103. 

Statistic, definition of, 2. 

Statistical hypothesis, 173. 

Absimctf data quoted from, (Table 1.2), 
3. 

- Beview of England and Walee^ data from, 

(Table 1.1), 3 ; (Table L3), 6 ; (Table 1.12), 

11 . 

-- Studies in the New York Money Market 

(Norton), 28. 

Statistics, definition of, 1-2. 

Stature, see Height. 

Steffensen, J., on Type* B series, 153, 154 ; refs., 
Heeent Researches in the Theory of Statistics 
and Actuarial Science, 161. 

Steieogram, 20-1. 

Stieltjes, J., problem of moments (Exorcise 3.12), 
88, 106-7, 109; refs., 114. 

—— integrals, 15-16 ; refs. (Shohat), 22. 

Stigmatic rays, distribution of poppies acc'ording 
to, (Table 1.5), 7. 

Stouffer, K. A., distribution of difference of Typ<* 
III variates, (Exercise 10.6), 252. 

Student" (W. S. Gosset), mfs., Poisson dis- 
tribution, 134; probable error of mean, 
251 ; sampling of Spearman's coefficients 
of rank correlation, 436, 

Student’s ” distribution, (Example 10,0), 239- 
40; (Example 10.17), 248 ; in testing 
correlation coefficient, 343 ; in testing 
S|>earman’s p, 401 ; in testing regression 
coefficients, 349. 

Succession rule of Laplace, (Examj)le 7.7), 177. 

Suicides, distribution of, (Table 1.6), 7, 

Sum of two variates, distribution of, 246 ~7. 

Sur-tax and super-tax, distribution of iiicoiues 
liable to, (Table 1.2), 3 and histogram 
(Fig. J.2), 4. 

distribution, see “ Student’s ” distribution. 

Tchebyebeff, P. L., problem of moments, 114; 
inequality, (Exorcise 8.4), 203. 

Tchebycheff-Hermite pol>momials, 145-7 ; refs,, 
160. 

Teeth and feeding in infants, (Example 12.5), 304. 

Telephone directory, distribution of digits fiom, 
(Table L4), 6, J93. 

Term of abortion, distribution of women according 
to, (Table 1.23), 26. 

Tetrachoric functions, 151, 356. 

— r, 354^6. 

Thiele, T. H., cumulanta, 61; quotation abo\it 
oracles, 178; sampling cumxilants, 256; 
refs., Theory of Olmrvcaions, 86, 285. 

Thompson, C., tables of ^^4. 


Ticket sampling, 192. 

Tippett, L, H. C., Handom Sampling Humbefrs, 
193, 197 ; distribution of eidreme values, 
220 ami refs., 229; distribution of range, 
223-4 and refe,, 229. 

Tocher, J. F., data from, (Table 1.25), 27. 

Transformation of a variate, 16, 21--2, 

Trigonometrical representation of correlationa, 
372. 

Tnmcated distributions, 11. 

Trypanosomes, distribution of, (Table 1.13), 12. 

Tschuprow, A. A., sampling moments, 256 ,* co- 
efficiont of contingency, 320 ; refs., sampling 
moments, 284, 285. 

Tsetse flies, distribution of trjqianosomes in, 
(Table 1.13), 12. 

Tyjx) A, Ty}x^ B series, see Gram-Charlier series, 

Tyj>e I distribution, 139-40. 

- 11 distribution, 141-2 ; distribution of means 

from (Exercise 10.4), 251. 

- Ill distribution, characteristic function and 

moments of, (Example 3.6), 55-6 ; oumu- 
loTits of, (Example 3.11), 67 ; generally, 
142 ; as sam]:>liiig distribution of sum of 
variances, 231-3 ; distribution of moans 
from (Example 10.11), 244; of geometric 
means from, (ExfTcise 10.2), 261 ; dis¬ 
tribution of diffc'renrcs (Exercis(* 

10.6), 262. 

-IV distribution, 140-1. 

- -- V distribution, 141; moments and currm- 
lanis, (Exercise 3.12), 67-8. 

- VI distribution, 140. 

- VJI distribution, 142 ; moments of, (Exer¬ 
cise 3.1), 86. 

T^ fies VIJI-XIX distributions, 142-3. 

U-shaped distributiorif?, 10--1I. 

Unbiased estimates, 200. 

Unimodal distributions, 29. 

Uspensky, J. V., refs., Ctmtral Limit Theorem, 

• 183 ; hitroduction to Mathematical Proba¬ 
bility, 184, 251. 

Variable, random, Random variable. 

Variance, 39 ; as half mean-aquarti of differences, 
42; standard error of, 224 ; distribution 
of, in normal samples, (Example 10.5), 
238-9, (Example 10.14), 246; of second 
mean-moment, (Example 11.2), 265 ; third 
moment of, (Example 11.3), 266. 

Variate, definition of, 2; traasfonnations of, 
16-18, 21-2. 

Variation, coefficient of, 43 ; standard error of, 
(Example 9.6), 209, 224. 

Venn, J. A., refs.. Logic of Oumce, 184. 

Vigor, H. D., data from, (Table 14.2), 326. 
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W. A., comlaiion for ranked 
data, 437 tod (Eieereiaie 16.3), 437. 

Weather, cdrmlati 0 n with erope, (Example 15.1), 
373 -^ 6 . 

Weierehaeis, K., diagonal process, 100; theorem 
on series of polynomials, (Exercise 4.7), 116. 

Wei^it, distribution of men according to, (Table 

1 . 10 ), 10 . 

Weldon, W. F. B., dice-throwing data, (Table 1.14), 
10; (Table 1.16), 28; (Table 5.1), 117; 
(Example 8.10), 199. 

Wheat, correlation of yields with potatoes, (Table 
14.4), 838; (Example 14.3), 332~-4. 

-plants, distribution of ranks according to 

height, (Table 8.1), 187. 

Whist, distribution of first hands at, (Table 5.4), 
128; (Example 12.1), 297-8. 

Whitaker, L., refs., Poisson distribution, 134. 

Wioksell, S. D., example from, (Example 14.4), 336. 

Willcox, W. F., definitions of statistics, 1, refs., 22. 

Wilson, E. B,, limiting distribution of 294-6 
and refs., 305. 

Wishart, J., introduction of word “ cumulant,” 
85; refs. ; Bomanovsky’s generalisation 
of Pearson distributions, 161 ; derivation 
of pattern formulae (under Fisher), 285 ; 
sampling cumulant fonnulao, 285 ; dis¬ 
tribution of multiple correlation and cor¬ 
relation ratios, 386. 

Wold, H., Sheppard’s corrections, 71, 80 ; refs., 86. 

Women, distribution of according to tei*m of 
abortion, (Table 1.23), 26. 

Woo, T. L., data from, on skulls (Tabic 1.22), 26 ; 
on association of hand and eye, (Exercise 
13.6), 323 ; tables of correlation ratio, 354. 


Vasukawa, refls., standard errewf of mode, 
226. 

Yates, F., data from, height of'pitots, (Table 8.1)> 
187; Kandom Sampling Ntmibers, 194# 
197 ; tables of x\ 393; correction to 
for grouping, 303 and (Example 12.3) 804 ; 
refs., bias in sampling, 202; correction to 
306. 

Yield of grain, distribution of, (Table 1.18), 23; 
of wheat and potatoes, correlation of# 
(Table 14.4), 333, (Example 14.3), 832- 
334. 

Young, A. W., refs., sampling of correlation co¬ 
efficient (under Co-operative Study), 368. 

Yule, G. Udny, data from, poppies, (Table, 1.5), 7 ; 
sentonoo length, (Table 1.21), 25 ; industrial 
accidents, (Table 5.3), 124; prints on 
photographic paper, (Exorcise 12.8), 307 ; 
inoculation against cholera, (Example 13.1), 
309; births and registration districts, 
(Table 14.2), 326; data compiled from 
Fay, (Table 1.19), 24. 

Negatively indexed binomiaLs, (footnote), 
125; normal distribution (Exercise 5.6), 
136 ; bias in scale-reading, 188 ; tables of 
x\ 293 ; coefficients of association, 310-13 ; 
refs., reading a scale, 202 ; degrees of 
freedom in contingency tables, 305; theory 
of correlation, 363, 385, 386. 


s-distribution, (Example 10.18), 249; in testing 
correlation ratio, 353-4 ; in testing multiple 
correlation coefficient, 381-2; in testing 
concordance in rankings, 419. 
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